2023-05-05 15:58:45 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get state 2023-05-05 15:58:45 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to set attempt sync config 2023-05-05 15:58:45 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto 2023-05-05 15:58:45 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/283/0/logs.log 2023-05-05 15:58:45 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.2 2023-05-05 15:58:45 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-05-05 15:58:45 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source for heartbeat 2023-05-05 15:58:45 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to get the source definition 2023-05-05 15:58:45 INFO i.a.w.g.ReplicationWorkerFactory(create):95 - Setting up source... 2023-05-05 15:58:45 INFO i.a.w.g.ReplicationWorkerFactory(create):99 - Setting up destination... 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: '' 2023-05-05 15:58:45 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2023-05-05 15:58:45 INFO i.a.w.g.ReplicationWorkerFactory(create):108 - Setting up replication worker... 2023-05-05 15:58:45 INFO i.a.w.g.DefaultReplicationWorker(run):161 - start sync worker. job id: 283 attempt id: 0 2023-05-05 15:58:45 INFO i.a.w.g.DefaultReplicationWorker(run):163 - Committing states from replication activity 2023-05-05 15:58:45 INFO i.a.w.g.DefaultReplicationWorker(run):166 - Committing stats from replication activity 2023-05-05 15:58:45 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-05-05 15:58:45 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION ----- 2023-05-05 15:58:45 INFO i.a.w.g.DefaultReplicationWorker(run):182 - configured sync modes: {null.Case=full_refresh - overwrite} 2023-05-05 15:58:45 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-05-05 15:58:45 INFO i.a.w.i.DefaultAirbyteDestination(start):92 - Running destination... 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-05-05 15:58:45 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-bigquery:1.2.20 exists... 2023-05-05 15:58:45 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-bigquery:1.2.20 was found locally. 2023-05-05 15:58:45 INFO i.a.w.p.DockerProcessFactory(create):133 - Creating docker container = destination-bigquery-write-283-0-cqruu with resources io.airbyte.config.ResourceRequirements@1c4b19c8[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-05-05 15:58:45 INFO i.a.w.p.DockerProcessFactory(create):184 - Preparing command: docker run --rm --init -i -w /data/283/0 --log-driver none --name destination-bigquery-write-283-0-cqruu --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.2.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.2 -e WORKER_JOB_ID=283 airbyte/destination-bigquery:1.2.20 write --config destination_config.json --catalog destination_catalog.json 2023-05-05 15:58:45 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0 2023-05-05 15:58:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: '' 2023-05-05 15:58:45 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: '' 2023-05-05 15:58:45 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-salesforce:2.0.9 exists... 2023-05-05 15:58:45 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-salesforce:2.0.9 was found locally. 2023-05-05 15:58:45 INFO i.a.w.p.DockerProcessFactory(create):133 - Creating docker container = source-salesforce-read-283-0-urivi with resources io.airbyte.config.ResourceRequirements@a82085c[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-05-05 15:58:45 INFO i.a.w.p.DockerProcessFactory(create):184 - Preparing command: docker run --rm --init -i -w /data/283/0 --log-driver none --name source-salesforce-read-283-0-urivi --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-salesforce:2.0.9 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.2 -e WORKER_JOB_ID=283 airbyte/source-salesforce:2.0.9 read --config source_config.json --catalog source_catalog.json 2023-05-05 15:58:45 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0 2023-05-05 15:58:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):310 - Destination output thread started. 2023-05-05 15:58:45 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes. 2023-05-05 15:58:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):376 - Replication thread started. 2023-05-05 15:58:47 source > Starting syncing SourceSalesforce 2023-05-05 15:58:47 destination > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2023-05-05 15:58:47 destination > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2023-05-05 15:58:47 destination > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: WRITE 2023-05-05 15:58:47 destination > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2023-05-05 15:58:47 source > Stream AIPredictionEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AIUpdateRecordEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AccountChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AccountContactRoleChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ActivityHistory is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AggregateResult is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AssetChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AssetTokenEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AsyncOperationEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AsyncOperationStatus is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AttachedContentDocument is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AttachedContentNote is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream AuthorizationFormConsentChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream BatchApexErrorEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CampaignChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CampaignMemberChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CampaignMemberStatusChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CaseChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CaseContacts__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CaseLotPool__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CaseRoutingHelper__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Case_Quality__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CombinedAttachment is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream CommSubscriptionConsentChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContactChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContactPointAddressChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContactPointConsentChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContactPointEmailChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContactPointPhoneChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContactPointTypeConsentChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContentBody is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContractChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ContractLineItemChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream EmailMessageChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream EmailStatus is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream EmailTemplateChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream EntitlementChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream EventChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream EventRelationChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream FeedLike is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream FeedSignal is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream FeedTrackedChange is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream FlowExecutionErrorEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream FlowPersonalConfiguration__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream FlowTableViewDefinition__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream FolderedContentDocument is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream IndividualChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream LeadChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ListEmailChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream LocationChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream LogoutEventStream is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream LookedUpFromActivity is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Lot_Measurement__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Lot_Partner__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream MacroChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream MacroInstructionChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Name is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream NoteAndAttachment is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream OmnichannelSyncWebhook__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream OpenActivity is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream OpportunityChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream OpportunityContactRoleChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream OrderChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream OrderItemChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream OrgLifecycleNotification is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream OwnedContentDocument is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream PL_Count_ID__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Parking_Lot_Rule__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Parking_Lot__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream PartyConsentChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream PlatformStatusAlertEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Pricebook2ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ProcessExceptionEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ProcessInstanceHistory is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Product2ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream QuickTextChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream QuoteChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream QuoteLineItemChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream QuoteTemplateRichTextData is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream RecommendationChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream Sales_Handover__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ServiceContractChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ServiceResourceChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream SocialPostChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream TaskChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream TaskRelationChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream UserChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream dlrs__DeclarativeLookupRollupSummaries__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream dlrs__LookupChildAReallyReallyReallyBigBigName__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream dlrs__LookupChild__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream dlrs__LookupParent__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream dlrs__LookupRollupCalculateJob__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream dlrs__LookupRollupSummaryLog__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream dlrs__LookupRollupSummaryScheduleItems__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream dlrs__LookupRollupSummary__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream ers_datatableConfig__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Custom_Relationship__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Customer_Buying_Center__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Default_Org_Chart_Configurations__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__MilestoneTemplate__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Milestone_Change_Event__e is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Milestone_Header__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Milestone__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Org_Chart_Configuration__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Org_Chart_Global_Settings__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Plan_Summary__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Product_Offering__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Relationship__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Squivr_Trigger_Settings__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Tracked_Milestone__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Whitespace_Summary__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 source > Stream squivr__Whitespace_Template__ChangeEvent is not queryable and will be ignored. 2023-05-05 15:58:47 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-05-05 15:58:47 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-05-05 15:58:47 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2023-05-05 15:58:47 destination > INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):419 Selected loading method is set to: GCS 2023-05-05 15:58:47 source > Syncing stream: Case 2023-05-05 15:58:47 destination > INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 S3 format config: {"format_type":"AVRO","flattening":"No flattening"} 2023-05-05 15:58:47 destination > INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):435 All tmp files will be removed from GCS when replication is finished 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BigQueryDestination(getGcsRecordConsumer):315 Creating BigQuery staging message consumer with staging ID c9bbf696-15ff-4876-a499-840cb11f3bc8 at 2023-05-05T15:58:47.749Z 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):93 BigQuery write config: BigQueryWriteConfig[streamName=Case, namespace=test_patricia, datasetId=test_patricia, datasetLocation=europe-west3, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_tmp_unl_Case}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=overwrite, stagedFiles=[]] 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):146 class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):116 Preparing airbyte_raw tables in destination started for 1 streams 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):118 Preparing staging are in destination for schema: Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, stream: Case, target table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}}, stage: Case 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createSchemaIfNotExists):86 Creating dataset test_patricia 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createTableIfNotExists):102 Creating target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BigQueryUtils(createPartitionedTableIfNotExists):224 Partitioned table ALREADY EXISTS: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} 2023-05-05 15:58:48 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):109 Creating staging path for stream Case (dataset test_patricia): data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ 2023-05-05 15:58:49 destination > INFO i.a.i.d.b.BigQueryGcsOperations(truncateTableIfExists):207 Truncating target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia) 2023-05-05 15:58:49 destination > INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):175 Deleting target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia) 2023-05-05 15:58:49 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:58:49 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createTableIfNotExists):102 Creating target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} 2023-05-05 15:58:49 destination > INFO i.a.i.d.b.BigQueryUtils(createPartitionedTableIfNotExists):227 Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} 2023-05-05 15:58:49 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):131 Preparing airbyte_raw tables in destination completed. 2023-05-05 15:58:49 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:58:50 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:58:51 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:58:52 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:58:53 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:58:54 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:58:55 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:58:59 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:59:03 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:59:06 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:59:10 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4R4AAL to complete. Current state: InProgress 2023-05-05 15:59:15 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):76 Starting a new buffer for stream Case (current state: 0 bytes in 0 buffers) 2023-05-05 15:59:15 destination > INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 Default schema. 2023-05-05 15:59:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 5000 (18 MB) 2023-05-05 15:59:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 10000 (36 MB) 2023-05-05 15:59:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 15000 (55 MB) 2023-05-05 15:59:49 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 15:59:49 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 15:59:50 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 15:59:51 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 15:59:51 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 15:59:52 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 15:59:53 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 15:59:55 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 15:59:59 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 16:00:03 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 16:00:06 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 16:00:10 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 16:00:14 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4MWAA1 to complete. Current state: InProgress 2023-05-05 16:00:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 20000 (74 MB) 2023-05-05 16:00:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 25000 (92 MB) 2023-05-05 16:00:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 30000 (111 MB) 2023-05-05 16:00:53 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:00:54 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:00:55 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:00:56 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:00:56 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:00:57 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:00:58 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:01:00 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:01:04 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:01:08 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:01:12 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:01:15 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:01:19 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4wsAAD to complete. Current state: InProgress 2023-05-05 16:01:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 35000 (130 MB) 2023-05-05 16:01:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 40000 (149 MB) 2023-05-05 16:01:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 45000 (168 MB) 2023-05-05 16:01:59 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: UploadComplete 2023-05-05 16:01:59 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:00 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:01 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:02 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:02 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:04 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:05 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:09 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:13 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:16 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:20 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:24 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:27 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4yKAAT to complete. Current state: InProgress 2023-05-05 16:02:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 50000 (187 MB) 2023-05-05 16:02:49 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):121 Flushing buffer of stream Case (200 MB) 2023-05-05 16:02:49 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):147 Flushing buffer for stream Case (200 MB) to staging 2023-05-05 16:02:49 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 Finished writing data to 82795bf3-a6f1-4ea4-8b90-75f1b6361dec12304962622270477551.avro (200 MB) 2023-05-05 16:02:49 destination > INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):116 Uploading records to staging for stream Case (dataset test_patricia): data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ 2023-05-05 16:02:50 destination > INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with full ID ABPnzm568wsTHv1mLjsXwm0uGsQJO7uzA5ridPphF2jxPgXA4eDia8pZtuM4YPx7ZdN-f47f 2023-05-05 16:02:50 destination > INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-05-05 16:02:50 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 4 containing 10.01 MB] 2023-05-05 16:02:50 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 7 containing 10.01 MB] 2023-05-05 16:02:50 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 5 containing 10.01 MB] 2023-05-05 16:02:50 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 1 containing 10.01 MB] 2023-05-05 16:02:50 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 8 containing 10.01 MB] 2023-05-05 16:02:50 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 6 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 9 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 3 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 10 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 2 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 13 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 18 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 11 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 15 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 16 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 17 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 12 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 19 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 14 containing 10.01 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Finished uploading [Part number 20 containing 9.88 MB] 2023-05-05 16:02:51 destination > INFO a.m.s.StreamTransferManager(complete):395 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro with id ABPnzm568...7ZdN-f47f]: Completed 2023-05-05 16:02:51 destination > INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):214 Uploaded buffer file to storage: 82795bf3-a6f1-4ea4-8b90-75f1b6361dec12304962622270477551.avro -> data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro (filename: 0.avro) 2023-05-05 16:02:51 destination > INFO i.a.i.d.s.S3StorageOperations(uploadRecordsToBucket):131 Successfully loaded records to stage data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ with 0 re-attempt(s) 2023-05-05 16:02:51 destination > INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):61 Added staged file: 0.avro 2023-05-05 16:02:51 destination > INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTableFromStage):133 Uploading records from staging files to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia): [0.avro] 2023-05-05 16:02:51 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):138 Uploading staged file: gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro 2023-05-05 16:02:51 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):147 [JobId{project=parkdepot-prod, job=3fea4aae-19be-4b32-929d-a6c2391e80b2, location=europe-west3}] Created a new job to upload record(s) to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia): Job{job=JobId{project=parkdepot-prod, job=3fea4aae-19be-4b32-929d-a6c2391e80b2, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683302571621, endTime=null, startTime=1683302571728, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=bVC1irWDeLgOE6y3LcQlig==, generatedId=parkdepot-prod:europe-west3.3fea4aae-19be-4b32-929d-a6c2391e80b2, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/3fea4aae-19be-4b32-929d-a6c2391e80b2?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2023-05-05 16:02:51 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):443 Waiting for job finish Job{job=JobId{project=parkdepot-prod, job=3fea4aae-19be-4b32-929d-a6c2391e80b2, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683302571621, endTime=null, startTime=1683302571728, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=bVC1irWDeLgOE6y3LcQlig==, generatedId=parkdepot-prod:europe-west3.3fea4aae-19be-4b32-929d-a6c2391e80b2, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/3fea4aae-19be-4b32-929d-a6c2391e80b2?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2023-05-05 16:02:58 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):445 Job finish Job{job=JobId{project=parkdepot-prod, job=3fea4aae-19be-4b32-929d-a6c2391e80b2, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683302571621, endTime=null, startTime=1683302571728, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=bVC1irWDeLgOE6y3LcQlig==, generatedId=parkdepot-prod:europe-west3.3fea4aae-19be-4b32-929d-a6c2391e80b2, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/3fea4aae-19be-4b32-929d-a6c2391e80b2?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2023-05-05 16:02:58 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):152 [JobId{project=parkdepot-prod, job=3fea4aae-19be-4b32-929d-a6c2391e80b2, location=europe-west3}] Target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia) is successfully appended with staging files 2023-05-05 16:02:58 destination > INFO i.a.i.d.r.FileBuffer(deleteFile):109 Deleting tempFile data 82795bf3-a6f1-4ea4-8b90-75f1b6361dec12304962622270477551.avro 2023-05-05 16:02:58 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):125 Flushing completed for Case 2023-05-05 16:02:58 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):76 Starting a new buffer for stream Case (current state: -322 bytes in 0 buffers) 2023-05-05 16:02:58 destination > INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 Default schema. 2023-05-05 16:03:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 55000 (206 MB) 2023-05-05 16:03:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 60000 (225 MB) 2023-05-05 16:03:15 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:15 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:16 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:17 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:18 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:18 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:20 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:22 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:25 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:29 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:33 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:37 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:40 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4gRAAT to complete. Current state: InProgress 2023-05-05 16:03:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 65000 (244 MB) 2023-05-05 16:04:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 70000 (263 MB) 2023-05-05 16:04:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 75000 (282 MB) 2023-05-05 16:04:19 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:19 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:20 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:21 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:22 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:22 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:24 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:25 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:29 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:33 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:36 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:40 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zIAAT to complete. Current state: InProgress 2023-05-05 16:04:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 80000 (300 MB) 2023-05-05 16:05:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 85000 (319 MB) 2023-05-05 16:05:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 90000 (338 MB) 2023-05-05 16:05:18 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:19 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:20 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:20 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:21 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:22 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:23 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:25 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:29 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:32 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:37 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:41 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zNAAT to complete. Current state: InProgress 2023-05-05 16:05:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 95000 (356 MB) 2023-05-05 16:06:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 100000 (374 MB) 2023-05-05 16:06:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 105000 (393 MB) 2023-05-05 16:06:17 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:18 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:19 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:19 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:20 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:21 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:22 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:24 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:28 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:31 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:35 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:39 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4JpAAL to complete. Current state: InProgress 2023-05-05 16:06:46 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):121 Flushing buffer of stream Case (200 MB) 2023-05-05 16:06:46 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):147 Flushing buffer for stream Case (200 MB) to staging 2023-05-05 16:06:46 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 Finished writing data to a61f6a83-1813-4aa1-b10d-7a2b5aeb619d2458018173044054565.avro (200 MB) 2023-05-05 16:06:46 destination > INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):116 Uploading records to staging for stream Case (dataset test_patricia): data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with full ID ABPnzm4Z3w1ckDnnpS5n-jqO60x4qyDx0rcusYbcnoVHBkwbrrfaeW2IB719UnJMBgBP778z 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 1 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 2 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 6 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 3 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 4 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 5 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 8 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 9 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 7 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 13 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 12 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 17 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 15 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 14 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 11 containing 10.01 MB] 2023-05-05 16:06:46 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 10 containing 10.01 MB] 2023-05-05 16:06:47 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 16 containing 10.01 MB] 2023-05-05 16:06:47 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 18 containing 10.01 MB] 2023-05-05 16:06:47 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 19 containing 10.01 MB] 2023-05-05 16:06:47 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Finished uploading [Part number 20 containing 9.87 MB] 2023-05-05 16:06:47 destination > INFO a.m.s.StreamTransferManager(complete):395 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro with id ABPnzm4Z3...MBgBP778z]: Completed 2023-05-05 16:06:47 destination > INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):214 Uploaded buffer file to storage: a61f6a83-1813-4aa1-b10d-7a2b5aeb619d2458018173044054565.avro -> data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro (filename: 1.avro) 2023-05-05 16:06:47 destination > INFO i.a.i.d.s.S3StorageOperations(uploadRecordsToBucket):131 Successfully loaded records to stage data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ with 0 re-attempt(s) 2023-05-05 16:06:47 destination > INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):61 Added staged file: 1.avro 2023-05-05 16:06:47 destination > INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTableFromStage):133 Uploading records from staging files to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia): [1.avro] 2023-05-05 16:06:47 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):138 Uploading staged file: gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro 2023-05-05 16:06:47 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):147 [JobId{project=parkdepot-prod, job=9ead830d-2951-46de-8616-0100c551be95, location=europe-west3}] Created a new job to upload record(s) to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia): Job{job=JobId{project=parkdepot-prod, job=9ead830d-2951-46de-8616-0100c551be95, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683302807377, endTime=null, startTime=1683302807452, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=3AefKBdVP4FJhMLAUvV9wA==, generatedId=parkdepot-prod:europe-west3.9ead830d-2951-46de-8616-0100c551be95, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/9ead830d-2951-46de-8616-0100c551be95?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2023-05-05 16:06:47 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):443 Waiting for job finish Job{job=JobId{project=parkdepot-prod, job=9ead830d-2951-46de-8616-0100c551be95, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683302807377, endTime=null, startTime=1683302807452, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=3AefKBdVP4FJhMLAUvV9wA==, generatedId=parkdepot-prod:europe-west3.9ead830d-2951-46de-8616-0100c551be95, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/9ead830d-2951-46de-8616-0100c551be95?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2023-05-05 16:06:54 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):445 Job finish Job{job=JobId{project=parkdepot-prod, job=9ead830d-2951-46de-8616-0100c551be95, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683302807377, endTime=null, startTime=1683302807452, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=3AefKBdVP4FJhMLAUvV9wA==, generatedId=parkdepot-prod:europe-west3.9ead830d-2951-46de-8616-0100c551be95, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/9ead830d-2951-46de-8616-0100c551be95?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2023-05-05 16:06:54 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):152 [JobId{project=parkdepot-prod, job=9ead830d-2951-46de-8616-0100c551be95, location=europe-west3}] Target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia) is successfully appended with staging files 2023-05-05 16:06:54 destination > INFO i.a.i.d.r.FileBuffer(deleteFile):109 Deleting tempFile data a61f6a83-1813-4aa1-b10d-7a2b5aeb619d2458018173044054565.avro 2023-05-05 16:06:54 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):125 Flushing completed for Case 2023-05-05 16:06:54 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):76 Starting a new buffer for stream Case (current state: -644 bytes in 0 buffers) 2023-05-05 16:06:54 destination > INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 Default schema. 2023-05-05 16:07:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 110000 (411 MB) 2023-05-05 16:07:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 115000 (430 MB) 2023-05-05 16:07:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 120000 (448 MB) 2023-05-05 16:07:26 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: UploadComplete 2023-05-05 16:07:26 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: UploadComplete 2023-05-05 16:07:27 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: UploadComplete 2023-05-05 16:07:28 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: UploadComplete 2023-05-05 16:07:29 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: UploadComplete 2023-05-05 16:07:30 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: UploadComplete 2023-05-05 16:07:31 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: InProgress 2023-05-05 16:07:32 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: InProgress 2023-05-05 16:07:36 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: InProgress 2023-05-05 16:07:40 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: InProgress 2023-05-05 16:07:44 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: InProgress 2023-05-05 16:07:47 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: InProgress 2023-05-05 16:07:51 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4zXAAT to complete. Current state: InProgress 2023-05-05 16:08:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 125000 (467 MB) 2023-05-05 16:08:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 130000 (485 MB) 2023-05-05 16:08:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 135000 (504 MB) 2023-05-05 16:08:28 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:29 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:29 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:30 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:31 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:32 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:33 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:35 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:38 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:42 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:46 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:08:49 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4lqAAD to complete. Current state: InProgress 2023-05-05 16:09:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 140000 (522 MB) 2023-05-05 16:09:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 145000 (540 MB) 2023-05-05 16:09:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 150000 (559 MB) 2023-05-05 16:09:26 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:26 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:27 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:28 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:28 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:29 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:30 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:32 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:36 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:40 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:09:43 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN501AAD to complete. Current state: InProgress 2023-05-05 16:10:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 155000 (577 MB) 2023-05-05 16:10:09 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):121 Flushing buffer of stream Case (200 MB) 2023-05-05 16:10:09 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):147 Flushing buffer for stream Case (200 MB) to staging 2023-05-05 16:10:09 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 Finished writing data to 4302a224-501d-4866-ae33-75eba8ee23d910312537381193600106.avro (200 MB) 2023-05-05 16:10:09 destination > INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):116 Uploading records to staging for stream Case (dataset test_patricia): data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with full ID ABPnzm5HZvnGVTNOom2-Y3iSGrDvioG9dhI5GUkh3nORsvugRgntRpbMeHNBUXbrNceCzXHu 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 2 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 1 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 6 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 4 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 7 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 5 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 3 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 9 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 8 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 12 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 11 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 10 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 17 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 14 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 18 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 15 containing 10.01 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 20 containing 9.86 MB] 2023-05-05 16:10:09 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 19 containing 10.01 MB] 2023-05-05 16:10:10 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 13 containing 10.01 MB] 2023-05-05 16:10:10 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Finished uploading [Part number 16 containing 10.01 MB] 2023-05-05 16:10:10 destination > INFO a.m.s.StreamTransferManager(complete):395 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro with id ABPnzm5HZ...rNceCzXHu]: Completed 2023-05-05 16:10:10 destination > INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):214 Uploaded buffer file to storage: 4302a224-501d-4866-ae33-75eba8ee23d910312537381193600106.avro -> data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro (filename: 2.avro) 2023-05-05 16:10:10 destination > INFO i.a.i.d.s.S3StorageOperations(uploadRecordsToBucket):131 Successfully loaded records to stage data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ with 0 re-attempt(s) 2023-05-05 16:10:10 destination > INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):61 Added staged file: 2.avro 2023-05-05 16:10:10 destination > INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTableFromStage):133 Uploading records from staging files to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia): [2.avro] 2023-05-05 16:10:10 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):138 Uploading staged file: gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro 2023-05-05 16:10:10 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):147 [JobId{project=parkdepot-prod, job=d9547e5a-a6fd-4553-9dc7-7a850f155637, location=europe-west3}] Created a new job to upload record(s) to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia): Job{job=JobId{project=parkdepot-prod, job=d9547e5a-a6fd-4553-9dc7-7a850f155637, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683303010293, endTime=null, startTime=1683303010389, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=OxxoZ/itv77XFn2A6TxByg==, generatedId=parkdepot-prod:europe-west3.d9547e5a-a6fd-4553-9dc7-7a850f155637, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/d9547e5a-a6fd-4553-9dc7-7a850f155637?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2023-05-05 16:10:10 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):443 Waiting for job finish Job{job=JobId{project=parkdepot-prod, job=d9547e5a-a6fd-4553-9dc7-7a850f155637, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683303010293, endTime=null, startTime=1683303010389, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=OxxoZ/itv77XFn2A6TxByg==, generatedId=parkdepot-prod:europe-west3.d9547e5a-a6fd-4553-9dc7-7a850f155637, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/d9547e5a-a6fd-4553-9dc7-7a850f155637?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2023-05-05 16:10:17 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):445 Job finish Job{job=JobId{project=parkdepot-prod, job=d9547e5a-a6fd-4553-9dc7-7a850f155637, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683303010293, endTime=null, startTime=1683303010389, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=OxxoZ/itv77XFn2A6TxByg==, generatedId=parkdepot-prod:europe-west3.d9547e5a-a6fd-4553-9dc7-7a850f155637, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/d9547e5a-a6fd-4553-9dc7-7a850f155637?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2023-05-05 16:10:17 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):152 [JobId{project=parkdepot-prod, job=d9547e5a-a6fd-4553-9dc7-7a850f155637, location=europe-west3}] Target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia) is successfully appended with staging files 2023-05-05 16:10:17 destination > INFO i.a.i.d.r.FileBuffer(deleteFile):109 Deleting tempFile data 4302a224-501d-4866-ae33-75eba8ee23d910312537381193600106.avro 2023-05-05 16:10:17 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):125 Flushing completed for Case 2023-05-05 16:10:17 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):76 Starting a new buffer for stream Case (current state: -966 bytes in 0 buffers) 2023-05-05 16:10:17 destination > INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 Default schema. 2023-05-05 16:10:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 160000 (595 MB) 2023-05-05 16:10:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 165000 (613 MB) 2023-05-05 16:10:30 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:31 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:32 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:32 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:33 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:34 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:35 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:37 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:40 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:44 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:10:48 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN4SBAA1 to complete. Current state: InProgress 2023-05-05 16:11:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 170000 (632 MB) 2023-05-05 16:11:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 175000 (652 MB) 2023-05-05 16:11:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 180000 (671 MB) 2023-05-05 16:11:26 source > Sleeping 0.501 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:27 source > Sleeping 0.502718281828459 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:28 source > Sleeping 0.5073890560989307 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:28 source > Sleeping 0.5200855369231877 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:29 source > Sleeping 0.5545981500331443 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:30 source > Sleeping 0.6484131591025766 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:31 source > Sleeping 0.9034287934927351 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:33 source > Sleeping 1.5966331584284585 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:37 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:40 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:44 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:48 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:11:51 source > Sleeping 3.4809579870417284 seconds while waiting for Job: Case/7500900000VN50QAAT to complete. Current state: InProgress 2023-05-05 16:12:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 185000 (692 MB) 2023-05-05 16:12:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):434 - Records read: 190000 (714 MB) 2023-05-05 16:12:25 source > Read 193792 records from Case stream 2023-05-05 16:12:25 source > Finished syncing Case 2023-05-05 16:12:25 source > SourceSalesforce runtimes: Syncing stream Case 0:13:37.691190 2023-05-05 16:12:25 source > Finished syncing SourceSalesforce 2023-05-05 16:12:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):438 - Source has no more messages, closing connection. 2023-05-05 16:12:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):447 - Total records read: 193792 (729 MB) 2023-05-05 16:12:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$8):456 - Schema validation was performed to a max of 10 records with errors per stream. 2023-05-05 16:12:25 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true 2023-05-05 16:12:25 INFO i.a.w.g.DefaultReplicationWorker(replicate):266 - Waiting for source and destination threads to complete. 2023-05-05 16:12:25 INFO i.a.w.g.DefaultReplicationWorker(replicate):271 - One of source or destination thread complete. Waiting on the other. 2023-05-05 16:12:25 destination > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded. 2023-05-05 16:12:25 destination > INFO i.a.i.d.b.BufferedStreamConsumer(close):257 executing on success close procedure. 2023-05-05 16:12:25 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):130 Flushing all 1 current buffers (139 MB in total) 2023-05-05 16:12:25 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):132 Flushing buffer of stream Case (139 MB) 2023-05-05 16:12:25 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):147 Flushing buffer for stream Case (139 MB) to staging 2023-05-05 16:12:25 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 Finished writing data to 9367d583-9a6d-43e9-8174-2775c7e0489b7730033168004037573.avro (139 MB) 2023-05-05 16:12:25 destination > INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):116 Uploading records to staging for stream Case (dataset test_patricia): data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ 2023-05-05 16:12:25 destination > INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with full ID ABPnzm4XOoHDUu4LC6-brpPjt8kWt7-KK2Nj3BQnNt8W7iq2r9EZHPD_0boO5-y6lHVgMCk_ 2023-05-05 16:12:25 destination > INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000] 2023-05-05 16:12:25 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 1 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 2 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 4 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 3 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 7 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 6 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 5 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 8 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 11 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 9 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 12 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 10 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 13 containing 10.01 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Finished uploading [Part number 14 containing 9.81 MB] 2023-05-05 16:12:26 destination > INFO a.m.s.StreamTransferManager(complete):395 [Manager uploading to gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro with id ABPnzm4XO...6lHVgMCk_]: Completed 2023-05-05 16:12:26 destination > INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):214 Uploaded buffer file to storage: 9367d583-9a6d-43e9-8174-2775c7e0489b7730033168004037573.avro -> data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro (filename: 3.avro) 2023-05-05 16:12:26 destination > INFO i.a.i.d.s.S3StorageOperations(uploadRecordsToBucket):131 Successfully loaded records to stage data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/ with 0 re-attempt(s) 2023-05-05 16:12:26 destination > INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):61 Added staged file: 3.avro 2023-05-05 16:12:26 destination > INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTableFromStage):133 Uploading records from staging files to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia): [3.avro] 2023-05-05 16:12:26 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):138 Uploading staged file: gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro 2023-05-05 16:12:26 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):147 [JobId{project=parkdepot-prod, job=3836a053-907f-4f20-865b-45efaa475738, location=europe-west3}] Created a new job to upload record(s) to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia): Job{job=JobId{project=parkdepot-prod, job=3836a053-907f-4f20-865b-45efaa475738, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683303146463, endTime=null, startTime=1683303146535, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=MYda+z4MIuOkLBgpADkSlA==, generatedId=parkdepot-prod:europe-west3.3836a053-907f-4f20-865b-45efaa475738, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/3836a053-907f-4f20-865b-45efaa475738?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2023-05-05 16:12:26 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):443 Waiting for job finish Job{job=JobId{project=parkdepot-prod, job=3836a053-907f-4f20-865b-45efaa475738, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683303146463, endTime=null, startTime=1683303146535, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=MYda+z4MIuOkLBgpADkSlA==, generatedId=parkdepot-prod:europe-west3.3836a053-907f-4f20-865b-45efaa475738, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/3836a053-907f-4f20-865b-45efaa475738?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2023-05-05 16:12:33 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):445 Job finish Job{job=JobId{project=parkdepot-prod, job=3836a053-907f-4f20-865b-45efaa475738, location=europe-west3}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1683303146463, endTime=null, startTime=1683303146535, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=warehouse-raw-layer@parkdepot-prod.iam.gserviceaccount.com, etag=MYda+z4MIuOkLBgpADkSlA==, generatedId=parkdepot-prod:europe-west3.3836a053-907f-4f20-865b-45efaa475738, selfLink=https://www.googleapis.com/bigquery/v2/projects/parkdepot-prod/jobs/3836a053-907f-4f20-865b-45efaa475738?location=europe-west3, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, projectId=parkdepot-prod, tableId=_airbyte_raw_Case}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://gcs_airbyte_dev_parkdepot/data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2023-05-05 16:12:33 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):152 [JobId{project=parkdepot-prod, job=3836a053-907f-4f20-865b-45efaa475738, location=europe-west3}] Target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=test_patricia, tableId=_airbyte_raw_Case}} (dataset test_patricia) is successfully appended with staging files 2023-05-05 16:12:33 destination > INFO i.a.i.d.r.FileBuffer(deleteFile):109 Deleting tempFile data 9367d583-9a6d-43e9-8174-2775c7e0489b7730033168004037573.avro 2023-05-05 16:12:33 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):134 Flushing completed for Case 2023-05-05 16:12:33 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(close):152 Closing buffer for stream Case 2023-05-05 16:12:33 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):190 Cleaning up destination started for 1 streams 2023-05-05 16:12:33 destination > INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):186 Cleaning up staging path for stream Case (dataset test_patricia): data_sync/test_patricia_Case 2023-05-05 16:12:33 destination > INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 Deleting object data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/0.avro 2023-05-05 16:12:33 destination > INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 Deleting object data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/1.avro 2023-05-05 16:12:33 destination > INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 Deleting object data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/2.avro 2023-05-05 16:12:33 destination > INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 Deleting object data_sync/test_patricia_Case/2023/05/05/15/c9bbf696-15ff-4876-a499-840cb11f3bc8/3.avro 2023-05-05 16:12:33 destination > INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):306 Storage bucket data_sync/test_patricia_Case has been cleaned-up (4 objects were deleted)... 2023-05-05 16:12:33 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):194 Cleaning up destination completed. 2023-05-05 16:12:33 destination > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2023-05-05 16:12:34 INFO i.a.w.g.DefaultReplicationWorker(replicate):273 - Source and destination threads complete. 2023-05-05 16:12:34 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):561 - sync summary: { "status" : "completed", "recordsSynced" : 193792, "bytesSynced" : 765007373, "startTime" : 1683302325688, "endTime" : 1683303154023, "totalStats" : { "bytesCommitted" : 765007373, "bytesEmitted" : 765007373, "destinationStateMessagesEmitted" : 0, "destinationWriteEndTime" : 1683303154019, "destinationWriteStartTime" : 1683302325779, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0, "recordsEmitted" : 193792, "recordsCommitted" : 193792, "replicationEndTime" : 1683303154023, "replicationStartTime" : 1683302325688, "sourceReadEndTime" : 1683303145609, "sourceReadStartTime" : 1683302325735, "sourceStateMessagesEmitted" : 0 }, "streamStats" : [ { "streamName" : "Case", "streamNamespace" : "test_patricia", "stats" : { "bytesCommitted" : 765007373, "bytesEmitted" : 765007373, "recordsEmitted" : 193792, "recordsCommitted" : 193792 } } ] } 2023-05-05 16:12:34 INFO i.a.w.g.DefaultReplicationWorker(getReplicationOutput):562 - failures: [ ] 2023-05-05 16:12:34 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-05-05 16:12:34 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-05-05 16:12:34 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END REPLICATION ----- 2023-05-05 16:12:34 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-05-05 16:12:34 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):157 - sync summary: io.airbyte.config.StandardSyncOutput@4ca75da6[standardSyncSummary=io.airbyte.config.StandardSyncSummary@3c73ecca[status=completed,recordsSynced=193792,bytesSynced=765007373,startTime=1683302325688,endTime=1683303154023,totalStats=io.airbyte.config.SyncStats@214677ea[bytesCommitted=765007373,bytesEmitted=765007373,destinationStateMessagesEmitted=0,destinationWriteEndTime=1683303154019,destinationWriteStartTime=1683302325779,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=193792,recordsCommitted=193792,replicationEndTime=1683303154023,replicationStartTime=1683302325688,sourceReadEndTime=1683303145609,sourceReadStartTime=1683302325735,sourceStateMessagesEmitted=0,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@59d43f7b[streamName=Case,streamNamespace=test_patricia,stats=io.airbyte.config.SyncStats@2f68038a[bytesCommitted=765007373,bytesEmitted=765007373,destinationStateMessagesEmitted=,destinationWriteEndTime=,destinationWriteStartTime=,estimatedBytes=,estimatedRecords=,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,recordsEmitted=193792,recordsCommitted=193792,replicationEndTime=,replicationStartTime=,sourceReadEndTime=,sourceReadStartTime=,sourceStateMessagesEmitted=,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=,webhookOperationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@cdeaf11[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@1e356047[stream=io.airbyte.protocol.models.AirbyteStream@6662bb1d[name=Case,jsonSchema={"$schema":"http://json-schema.org/draft-07/schema#","additionalProperties":true,"type":"object","properties":{"Origin":{"type":["string","null"]},"Parking_Lot__c":{"type":["string","null"]},"LastModifiedDate":{"format":"date-time","type":["string","null"]},"Case_Resolution_Time__c":{"type":["number","null"]},"ServiceContractId":{"type":["string","null"]},"Hour_of_the_day__c":{"type":["number","null"]},"EntitlementId":{"type":["string","null"]},"Hubspot_Contact_Id__c":{"type":["string","null"]},"Prediction_Timestamp__c":{"format":"date-time","type":["string","null"]},"Number_of_Messages_Received__c":{"type":["number","null"]},"BusinessHoursId":{"type":["string","null"]},"SuppliedName":{"type":["string","null"]},"SuppliedPhone":{"type":["string","null"]},"IsClosedOnCreate":{"type":["boolean","null"]},"Hubspot_Created_Date__c":{"format":"date-time","type":["string","null"]},"Closed_Date_Formula__c":{"format":"date-time","type":["string","null"]},"First_Inbound_Email__c":{"format":"date-time","type":["string","null"]},"Status":{"type":["string","null"]},"ContactMobile":{"type":["string","null"]},"IsDeleted":{"type":["boolean","null"]},"Last_Outbound_Email__c":{"format":"date-time","type":["string","null"]},"InboxAT__c":{"type":["string","null"]},"Email_Inboxes__c":{"type":["string","null"]},"IsEscalated":{"type":["boolean","null"]},"Id":{"type":["string","null"]},"AssetId":{"type":["string","null"]},"Number_of_Messages_Sent__c":{"type":["number","null"]},"Description":{"type":["string","null"]},"Parking_Lot_Id__c":{"type":["string","null"]},"SuppliedCompany":{"type":["string","null"]},"SourceId":{"type":["string","null"]},"Parking_Lot_Account__c":{"type":["string","null"]},"SlaExitDate":{"format":"date-time","type":["string","null"]},"IsClosed":{"type":["boolean","null"]},"ContactPhone":{"type":["string","null"]},"Hubspot_Ticket_Id__c":{"type":["string","null"]},"OwnerId":{"type":["string","null"]},"Closed_by__c":{"type":["string","null"]},"First_Closed_Date__c":{"format":"date-time","type":["string","null"]},"RecordTypeId":{"type":["string","null"]},"CaseNumber":{"type":["string","null"]},"Rating__c":{"type":["number","null"]},"Customer_Complaint__c":{"type":["boolean","null"]},"ParentId":{"type":["string","null"]},"SlaStartDate":{"format":"date-time","type":["string","null"]},"Country__c":{"type":["string","null"]},"ConvertedToLead__c":{"type":["boolean","null"]},"Licence_Plate__c":{"type":["string","null"]},"First_Outbound_or_Closed_Date__c":{"format":"date-time","type":["string","null"]},"First_Outbound_Email__c":{"format":"date-time","type":["string","null"]},"Support_Level__c":{"type":["string","null"]},"SystemModstamp":{"format":"date-time","type":["string","null"]},"Escalated_to__c":{"type":["string","null"]},"Type":{"type":["string","null"]},"ClosedDate":{"format":"date-time","type":["string","null"]},"Case_Language__c":{"type":["string","null"]},"State_Language__c":{"type":["string","null"]},"AccountId":{"type":["string","null"]},"SignatureAddressFormula__c":{"type":["string","null"]},"Customer_Email__c":{"type":["string","null"]},"ProductId":{"type":["string","null"]},"Hubspot_Case_Owner__c":{"type":["string","null"]},"File_number__c":{"type":["string","null"]},"CreatedById":{"type":["string","null"]},"Due_Date__c":{"format":"date","type":["string","null"]},"CaseOriginWeb__c":{"type":["number","null"]},"Case_Quality__c":{"type":["string","null"]},"SuppliedEmailDomain__c":{"type":["string","null"]},"Import__c":{"type":["boolean","null"]},"Closed_hour_of_the_day__c":{"type":["number","null"]},"MasterRecordId":{"type":["string","null"]},"Rating_Reason__c":{"type":["string","null"]},"Priority":{"type":["string","null"]},"LastViewedDate":{"format":"date-time","type":["string","null"]},"First_Inbound_Email_Address__c":{"type":["string","null"]},"MilestoneStatus":{"type":["string","null"]},"IsStopped":{"type":["boolean","null"]},"Salutation__c":{"type":["string","null"]},"Hubspot_Closed_Date__c":{"format":"date-time","type":["string","null"]},"CreatedDate":{"format":"date-time","type":["string","null"]},"Hubspot_PD_Kategorie__c":{"type":["string","null"]},"Lead__c":{"type":["string","null"]},"PO1__c":{"type":["number","null"]},"Language_Predicted__c":{"type":["boolean","null"]},"LastReferencedDate":{"format":"date-time","type":["string","null"]},"ContactId":{"type":["string","null"]},"Reason":{"type":["string","null"]},"Enforcement__c":{"type":["boolean","null"]},"SuppliedEmail":{"type":["string","null"]},"Language":{"type":["string","null"]},"Confidence_Language_Prediction__c":{"type":["number","null"]},"SupportTier__c":{"type":["number","null"]},"Last_Inbound_Email__c":{"format":"date-time","type":["string","null"]},"WebFormPhone__c":{"type":["string","null"]},"Case_Evaluation__c":{"type":["boolean","null"]},"ContactFax":{"type":["string","null"]},"InboxDEen__c":{"type":["string","null"]},"CreatedDate_Formula__c":{"format":"date-time","type":["string","null"]},"InboxCHde__c":{"type":["string","null"]},"Comments":{"type":["string","null"]},"First_Response_Time_h__c":{"type":["number","null"]},"StopStartDate":{"format":"date-time","type":["string","null"]},"Subject":{"type":["string","null"]},"personAccTypeFormula__c":{"type":["string","null"]},"InboxCHfr__c":{"type":["string","null"]},"ContactEmail":{"type":["string","null"]},"Case_Web_Source__c":{"type":["string","null"]},"LastModifiedById":{"type":["string","null"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[SystemModstamp],sourceDefinedPrimaryKey=[[Id]],namespace=test_patricia,additionalProperties={}],syncMode=full_refresh,cursorField=[SystemModstamp],destinationSyncMode=overwrite,primaryKey=[[Id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}] 2023-05-05 16:12:34 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):162 - Sync summary length: 7827 2023-05-05 16:12:34 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-05-05 16:12:34 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):125 - Using protocol v0 2023-05-05 16:12:34 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):145 - Using normalization: airbyte/normalization:0.4.0 2023-05-05 16:12:34 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/283/0/logs.log 2023-05-05 16:12:34 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.2 2023-05-05 16:12:34 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation 2023-05-05 16:12:34 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-05-05 16:12:34 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):129 - Running with normalization version: airbyte/normalization:0.4.0 2023-05-05 16:12:34 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION ----- 2023-05-05 16:12:34 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-05-05 16:12:34 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization:0.4.0 exists... 2023-05-05 16:12:34 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization:0.4.0 was found locally. 2023-05-05 16:12:34 INFO i.a.w.p.DockerProcessFactory(create):133 - Creating docker container = normalization-normalize-283-0-saome with resources io.airbyte.config.ResourceRequirements@230d469d[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null 2023-05-05 16:12:34 INFO i.a.w.p.DockerProcessFactory(create):184 - Preparing command: docker run --rm --init -i -w /data/283/0/normalize --log-driver none --name normalization-normalize-283-0-saome --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.44.2 airbyte/normalization:0.4.0 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2023-05-05 16:12:34 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/283/0/normalize 2023-05-05 16:12:35 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/283/0/normalize') 2023-05-05 16:12:35 normalization > transform_bigquery 2023-05-05 16:12:35 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/283/0/normalize --catalog destination_catalog.json --out /data/283/0/normalize/models/generated/ --json-column _airbyte_data 2023-05-05 16:12:36 normalization > Processing destination_catalog.json... 2023-05-05 16:12:36 normalization > Generating airbyte_ctes/test_patricia/Case_ab1.sql from Case 2023-05-05 16:12:36 normalization > Generating airbyte_ctes/test_patricia/Case_ab2.sql from Case 2023-05-05 16:12:36 normalization > Generating airbyte_ctes/test_patricia/Case_ab3.sql from Case 2023-05-05 16:12:36 normalization > Adding drop table hook for Case_scd to Case 2023-05-05 16:12:36 normalization > Generating airbyte_tables/test_patricia/Case.sql from Case 2023-05-05 16:12:36 normalization > detected no config file for ssh, assuming ssh is off. 2023-05-05 16:12:39 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2023-05-05 16:12:39 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2023-05-05 16:12:39 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-05-05 16:12:39 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2023-05-05 16:12:39 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2023-05-05 16:12:42 normalization > Running with dbt=1.0.0 2023-05-05 16:12:42 normalization > Partial parse save file not found. Starting full parse. 2023-05-05 16:12:43 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 2 unused configuration paths: - models.airbyte_utils.generated.airbyte_views - models.airbyte_utils.generated.airbyte_incremental 2023-05-05 16:12:43 normalization > Found 4 models, 0 tests, 0 snapshots, 0 analyses, 624 macros, 0 operations, 0 seed files, 1 source, 0 exposures, 0 metrics 2023-05-05 16:12:44 normalization > Concurrency: 8 threads (target='prod') 2023-05-05 16:12:45 normalization > 1 of 1 START table model test_patricia.Case............................................................................. [RUN] 2023-05-05 16:16:19 normalization > 1 of 1 OK created table model test_patricia.Case........................................................................ [CREATE TABLE (193.8k rows, 740.3 MB processed) in 214.77s] 2023-05-05 16:16:19 normalization > Finished running 1 table model in 216.26s. 2023-05-05 16:16:20 normalization > Completed successfully 2023-05-05 16:16:20 normalization > Done. PASS=1 WARN=0 ERROR=0 SKIP=0 TOTAL=1 2023-05-05 16:16:20 INFO i.a.w.n.DefaultNormalizationRunner(close):194 - Terminating normalization process... 2023-05-05 16:16:20 INFO i.a.w.n.DefaultNormalizationRunner(close):207 - Normalization process successfully terminated. 2023-05-05 16:16:20 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 3 minutes 46 seconds for job 283. 2023-05-05 16:16:20 INFO i.a.w.g.DefaultNormalizationWorker(run):109 - Normalization summary: io.airbyte.config.NormalizationSummary@7207740e[startTime=1683303154205,endTime=1683303380466,failures=[],additionalProperties={}] 2023-05-05 16:16:20 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling... 2023-05-05 16:16:20 INFO i.a.c.i.LineGobbler(voidCall):149 - 2023-05-05 16:16:20 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating... 2023-05-05 16:16:20 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END DEFAULT NORMALIZATION ----- 2023-05-05 16:16:20 INFO i.a.c.i.LineGobbler(voidCall):149 -