Airbyte incremental sync failed due to error: grpc: received message larger than max (4232580 vs. 4194304)

Airbyte incremental sync failed due to error grpc: received message larger than max (4232580 vs. 4194304), seems it has been exceeds temporal server(grpc)'s request payload size limit, is it possible to change limit setting? Thanks.

The connectors and settings:

  • MySQL CDC source with 30+ tables
  • BigQuery destination
  • Sync mode: Incremental | Deduped + history
  • Cron interval set to 30 minutes
  • Airbyte platform version v0.44.3
  • Airbyte MySQL source connector version v2.0.21
  • Airbyte BigQuery destination connector version v1.3.4

Job log history:

2023-05-16 19:30:11 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: false Normalization Supported: true, Feature Flag Enabled: false

2023-05-16 19:30:11 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to set attempt sync config

2023-05-16 19:31:11 WARN i.t.i.w.ActivityWorker$TaskHandlerImpl(logExceptionDuringResultReporting):365 - Failure during reporting of activity result to the server. ActivityId = 1fd85e42-6ffb-3271-955f-41698d7f6760, ActivityType = GetSyncWorkflowInputWithAttemptNumber, WorkflowId=connection_manager_1291b90a-46f7-4fed-ac1f-980fbc07637d, WorkflowType=ConnectionManagerWorkflow, RunId=8830060d-52da-42a9-8411-10d65d5a9435

io.grpc.StatusRuntimeException: RESOURCE_EXHAUSTED: grpc: received message larger than max (4232580 vs. 4194304)

at io.grpc.stub.ClientCalls.toStatusRuntimeException(ClientCalls.java:271) ~[grpc-stub-1.54.0.jar:1.54.0]

at io.grpc.stub.ClientCalls.getUnchecked(ClientCalls.java:252) ~[grpc-stub-1.54.0.jar:1.54.0]

at io.grpc.stub.ClientCalls.blockingUnaryCall(ClientCalls.java:165) ~[grpc-stub-1.54.0.jar:1.54.0]

at io.temporal.api.workflowservice.v1.WorkflowServiceGrpc$WorkflowServiceBlockingStub.respondActivityTaskCompleted(WorkflowServiceGrpc.java:3828) ~[temporal-serviceclient-1.17.0.jar:?]

at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.lambda$sendReply$0(ActivityWorker.java:303) ~[temporal-sdk-1.17.0.jar:?]

at io.temporal.internal.retryer.GrpcRetryer.lambda$retry$0(GrpcRetryer.java:52) ~[temporal-serviceclient-1.17.0.jar:?]

at io.temporal.internal.retryer.GrpcSyncRetryer.retry(GrpcSyncRetryer.java:67) ~[temporal-serviceclient-1.17.0.jar:?]

at io.temporal.internal.retryer.GrpcRetryer.retryWithResult(GrpcRetryer.java:60) ~[temporal-serviceclient-1.17.0.jar:?]

at io.temporal.internal.retryer.GrpcRetryer.retry(GrpcRetryer.java:50) ~[temporal-serviceclient-1.17.0.jar:?]

at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.sendReply(ActivityWorker.java:298) ~[temporal-sdk-1.17.0.jar:?]

at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:252) ~[temporal-sdk-1.17.0.jar:?]

at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?]

at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?]

at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?]

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]

at java.lang.Thread.run(Thread.java:1589) ~[?:?]