2022-09-18 22:59:50 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.credential: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_name: is not defined in the schema and the schema does not allow additional properties, $.gcs_bucket_path: is not defined in the schema and the schema does not allow additional properties, $.keep_files_in_gcs-bucket: is not defined in the schema and the schema does not allow additional properties, $.method: must be a constant value Standard 2022-09-18 22:59:50 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.credential.hmac_key_access_id: object found, string expected, $.credential.hmac_key_secret: object found, string expected 2022-09-18 22:59:50 INFO i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/538/0/logs.log 2022-09-18 22:59:50 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-09-18 22:59:50 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 22:59:50 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-09-18 22:59:50 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 22:59:50 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if albuspleskin/source-airbyte-konnektivecrm:test27 exists... 2022-09-18 22:59:50 INFO i.a.c.i.LineGobbler(voidCall):114 - albuspleskin/source-airbyte-konnektivecrm:test27 was found locally. 2022-09-18 22:59:50 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-airbyte-konnektivecrm-check-538-0-dnvzd with resources io.airbyte.config.ResourceRequirements@5d291515[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-09-18 22:59:50 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/538/0 --log-driver none --name source-airbyte-konnektivecrm-check-538-0-dnvzd --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=albuspleskin/source-airbyte-konnektivecrm:test27 -e AIRBYTE_VERSION=0.40.6 -e WORKER_JOB_ID=538 albuspleskin/source-airbyte-konnektivecrm:test27 check --config source_config.json 2022-09-18 22:59:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-09-18 22:59:59 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-09-18 22:59:59 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 22:59:59 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-09-18 22:59:59 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 22:59:59 INFO i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/538/0/logs.log 2022-09-18 22:59:59 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-09-18 22:59:59 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 22:59:59 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-09-18 22:59:59 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 23:00:00 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-bigquery:1.1.9 exists... 2022-09-18 23:00:00 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-bigquery:1.1.9 was found locally. 2022-09-18 23:00:00 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-bigquery-check-538-0-exgcm with resources io.airbyte.config.ResourceRequirements@5d291515[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-09-18 23:00:00 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/538/0 --log-driver none --name destination-bigquery-check-538-0-exgcm --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.9 -e AIRBYTE_VERSION=0.40.6 -e WORKER_JOB_ID=538 airbyte/destination-bigquery:1.1.9 check --config source_config.json 2022-09-18 23:00:00 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Class path contains multiple SLF4J bindings. 2022-09-18 23:00:00 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-09-18 23:00:00 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-09-18 23:00:00 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-09-18 23:00:00 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-09-18 23:00:01 ERROR i.a.c.i.LineGobbler(voidCall):114 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-09-18 23:00:02 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:02 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-09-18 23:00:02 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:02 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-09-18 23:00:02 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:02 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-09-18 23:00:02 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:02 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-09-18 23:00:02 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-18 23:00:02 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-18 23:00:02 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:02 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-18 23:00:03 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:03 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):301 - Selected loading method is set to: GCS 2022-09-18 23:00:04 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:04 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"CSV","flattening":"No flattening"} 2022-09-18 23:00:05 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:05 INFO i.a.i.d.s.S3Destination(testSingleUpload):81 - Started testing if all required credentials assigned to user for single file uploading 2022-09-18 23:00:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:06 INFO i.a.i.d.s.S3Destination(testSingleUpload):91 - Finished checking for normal upload mode 2022-09-18 23:00:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:06 INFO i.a.i.d.s.S3Destination(testMultipartUpload):95 - Started testing if all required credentials assigned to user for multipart upload 2022-09-18 23:00:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:06 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/test_1663542006078 with full ID ABPnzm5L6WO69fiLMugAipweMNFd9RkBMrtD8QnDFpmqCUSMmuvN_K5O2kGWGWpv4D8pUV0 2022-09-18 23:00:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:06 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-18 23:00:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:06 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-18 23:00:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:06 WARN a.m.s.MultiPartOutputStream(close):160 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-09-18 23:00:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:06 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to adtractive_airbyte_sync/data_syncs/test_1663542006078 with id ABPnzm5L6...pv4D8pUV0]: Uploading leftover stream [Part number 1 containing 3.34 MB] 2022-09-18 23:00:06 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:06 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/test_1663542006078 with id ABPnzm5L6...pv4D8pUV0]: Finished uploading [Part number 1 containing 3.34 MB] 2022-09-18 23:00:07 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:07 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/test_1663542006078 with id ABPnzm5L6...pv4D8pUV0]: Completed 2022-09-18 23:00:07 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:07 INFO i.a.i.d.s.S3Destination(testMultipartUpload):119 - Finished verification for multipart upload mode 2022-09-18 23:00:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):62 - 2022-09-18 23:00:08 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-09-18 23:00:08 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 23:00:08 INFO i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/538/0/logs.log 2022-09-18 23:00:08 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-09-18 23:00:08 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-09-18 23:00:08 INFO i.a.c.EnvConfigs(getEnvOrDefault):1096 - Using default value for environment variable METRIC_CLIENT: '' 2022-09-18 23:00:08 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-09-18 23:00:08 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):49 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-09-18 23:00:08 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 538 attempt id: 0 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-18 23:00:08 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.customers=incremental - append_dedup, null.order=incremental - append_dedup, null.transactions=incremental - append_dedup} 2022-09-18 23:00:08 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-bigquery:1.1.9 exists... 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-bigquery:1.1.9 was found locally. 2022-09-18 23:00:08 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-bigquery-write-538-0-fndyi with resources io.airbyte.config.ResourceRequirements@777ceb1[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-09-18 23:00:08 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/538/0 --log-driver none --name destination-bigquery-write-538-0-fndyi --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.9 -e AIRBYTE_VERSION=0.40.6 -e WORKER_JOB_ID=538 airbyte/destination-bigquery:1.1.9 write --config destination_config.json --catalog destination_catalog.json 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if albuspleskin/source-airbyte-konnektivecrm:test27 exists... 2022-09-18 23:00:08 INFO i.a.c.i.LineGobbler(voidCall):114 - albuspleskin/source-airbyte-konnektivecrm:test27 was found locally. 2022-09-18 23:00:08 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-airbyte-konnektivecrm-read-538-0-zkscy with resources io.airbyte.config.ResourceRequirements@5d83f838[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-09-18 23:00:08 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/538/0 --log-driver none --name source-airbyte-konnektivecrm-read-538-0-zkscy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=albuspleskin/source-airbyte-konnektivecrm:test27 -e AIRBYTE_VERSION=0.40.6 -e WORKER_JOB_ID=538 albuspleskin/source-airbyte-konnektivecrm:test27 read --config source_config.json --catalog source_catalog.json --state input_state.json 2022-09-18 23:00:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-09-18 23:00:08 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-09-18 23:00:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-09-18 23:00:09 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-09-18 23:00:09 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-09-18 23:00:09 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-09-18 23:00:09 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-09-18 23:00:09 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-09-18 23:00:10 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-09-18 23:00:11 source > Starting syncing SourceKonnektivecrm 2022-09-18 23:00:11 source > Syncing stream: customers 2022-09-18 23:00:12 destination > 2022-09-18 23:00:12 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-09-18 23:00:12 destination > 2022-09-18 23:00:12 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-09-18 23:00:12 destination > 2022-09-18 23:00:12 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-09-18 23:00:12 destination > 2022-09-18 23:00:12 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-09-18 23:00:12 destination > 2022-09-18 23:00:12 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-18 23:00:12 destination > 2022-09-18 23:00:12 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-18 23:00:12 destination > 2022-09-18 23:00:12 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-09-18 23:00:12 destination > 2022-09-18 23:00:12 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):301 - Selected loading method is set to: GCS 2022-09-18 23:00:13 destination > 2022-09-18 23:00:13 INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 - S3 format config: {"format_type":"AVRO","flattening":"No flattening"} 2022-09-18 23:00:13 destination > 2022-09-18 23:00:13 INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):317 - All tmp files will be removed from GCS when replication is finished 2022-09-18 23:00:14 destination > 2022-09-18 23:00:14 INFO i.a.i.d.b.BigQueryDestination(getGcsRecordConsumer):289 - Creating BigQuery staging message consumer with staging ID 1b6ee5df-d86b-4bd3-9939-c292f0a7449f at 2022-09-18T23:00:13.127Z 2022-09-18 23:00:14 destination > 2022-09-18 23:00:14 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=konnektivecrm_5_customers, namespace=null, datasetId=airbyte, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_customers}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]] 2022-09-18 23:00:14 destination > 2022-09-18 23:00:14 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=konnektivecrm_5_order, namespace=null, datasetId=airbyte, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_order}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]] 2022-09-18 23:00:14 destination > 2022-09-18 23:00:14 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):86 - BigQuery write config: BigQueryWriteConfig[streamName=konnektivecrm_5_transactions, namespace=null, datasetId=airbyte, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_transactions}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]] 2022-09-18 23:00:14 destination > 2022-09-18 23:00:14 INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-09-18 23:00:14 destination > 2022-09-18 23:00:14 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):98 - Preparing tmp tables in destination started for 3 streams 2022-09-18 23:00:14 destination > 2022-09-18 23:00:14 INFO i.a.i.d.b.BigQueryGcsOperations(createSchemaIfNotExists):86 - Creating dataset airbyte 2022-09-18 23:00:15 destination > 2022-09-18 23:00:15 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}} 2022-09-18 23:00:15 destination > 2022-09-18 23:00:15 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}} 2022-09-18 23:00:15 destination > 2022-09-18 23:00:15 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream konnektivecrm_5_transactions (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-18 23:00:15 destination > 2022-09-18 23:00:15 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ does not exist in bucket; creating... 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ has been created in bucket. 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream konnektivecrm_5_customers (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ does not exist in bucket; creating... 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ has been created in bucket. 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.b.BigQueryGcsOperations(createTmpTableIfNotExists):94 - Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):101 - Creating staging path for stream konnektivecrm_5_order (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-18 23:00:16 destination > 2022-09-18 23:00:16 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):97 - Storage Object adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ does not exist in bucket; creating... 2022-09-18 23:00:17 destination > 2022-09-18 23:00:17 INFO i.a.i.d.s.S3StorageOperations(createBucketObjectIfNotExists):99 - Storage Object adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ has been created in bucket. 2022-09-18 23:00:17 destination > 2022-09-18 23:00:17 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):107 - Preparing tmp tables in destination completed. 2022-09-18 23:00:19 destination > 2022-09-18 23:00:19 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_customers (current state: 0 bytes in 0 buffers) 2022-09-18 23:00:19 destination > 2022-09-18 23:00:19 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-18 23:00:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 1000 (2 MB) 2022-09-18 23:01:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 2000 (4 MB) 2022-09-18 23:01:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 3000 (6 MB) 2022-09-18 23:02:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 4000 (8 MB) 2022-09-18 23:02:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 5000 (11 MB) 2022-09-18 23:03:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 6000 (13 MB) 2022-09-18 23:03:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 7000 (16 MB) 2022-09-18 23:04:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 8000 (18 MB) 2022-09-18 23:04:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 9000 (21 MB) 2022-09-18 23:05:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 10000 (23 MB) 2022-09-18 23:05:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 11000 (25 MB) 2022-09-18 23:06:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 12000 (27 MB) 2022-09-18 23:06:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 13000 (29 MB) 2022-09-18 23:07:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 14000 (31 MB) 2022-09-18 23:07:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 15000 (33 MB) 2022-09-18 23:08:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 16000 (35 MB) 2022-09-18 23:08:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 17000 (37 MB) 2022-09-18 23:09:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 18000 (38 MB) 2022-09-18 23:09:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 19000 (40 MB) 2022-09-18 23:10:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 20000 (42 MB) 2022-09-18 23:10:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 21000 (44 MB) 2022-09-18 23:11:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 22000 (46 MB) 2022-09-18 23:11:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 23000 (48 MB) 2022-09-18 23:12:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 24000 (50 MB) 2022-09-18 23:12:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 25000 (52 MB) 2022-09-18 23:13:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 26000 (54 MB) 2022-09-18 23:13:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 27000 (56 MB) 2022-09-18 23:14:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 28000 (58 MB) 2022-09-18 23:14:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 29000 (60 MB) 2022-09-18 23:15:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 30000 (62 MB) 2022-09-18 23:15:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 31000 (64 MB) 2022-09-18 23:16:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 32000 (66 MB) 2022-09-18 23:16:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 33000 (68 MB) 2022-09-18 23:17:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 34000 (70 MB) 2022-09-18 23:17:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 35000 (72 MB) 2022-09-18 23:18:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 36000 (74 MB) 2022-09-18 23:18:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 37000 (76 MB) 2022-09-18 23:19:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 38000 (78 MB) 2022-09-18 23:19:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 39000 (80 MB) 2022-09-18 23:20:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 40000 (82 MB) 2022-09-18 23:20:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 41000 (84 MB) 2022-09-18 23:21:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 42000 (86 MB) 2022-09-18 23:21:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 43000 (89 MB) 2022-09-18 23:22:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 44000 (91 MB) 2022-09-18 23:22:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 45000 (93 MB) 2022-09-18 23:23:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 46000 (95 MB) 2022-09-18 23:23:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 47000 (97 MB) 2022-09-18 23:24:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 48000 (99 MB) 2022-09-18 23:25:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 49000 (101 MB) 2022-09-18 23:25:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 50000 (103 MB) 2022-09-18 23:26:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 51000 (105 MB) 2022-09-18 23:26:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 52000 (107 MB) 2022-09-18 23:27:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 53000 (110 MB) 2022-09-18 23:27:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 54000 (112 MB) 2022-09-18 23:28:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 55000 (114 MB) 2022-09-18 23:28:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 56000 (116 MB) 2022-09-18 23:29:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 57000 (118 MB) 2022-09-18 23:29:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 58000 (120 MB) 2022-09-18 23:30:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 59000 (122 MB) 2022-09-18 23:30:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 60000 (125 MB) 2022-09-18 23:31:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 61000 (127 MB) 2022-09-18 23:31:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 62000 (129 MB) 2022-09-18 23:32:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 63000 (131 MB) 2022-09-18 23:32:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 64000 (133 MB) 2022-09-18 23:33:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 65000 (135 MB) 2022-09-18 23:33:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 66000 (138 MB) 2022-09-18 23:34:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 67000 (140 MB) 2022-09-18 23:34:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 68000 (142 MB) 2022-09-18 23:35:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 69000 (144 MB) 2022-09-18 23:35:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 70000 (146 MB) 2022-09-18 23:36:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 71000 (148 MB) 2022-09-18 23:36:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 72000 (150 MB) 2022-09-18 23:37:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 73000 (152 MB) 2022-09-18 23:37:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 74000 (154 MB) 2022-09-18 23:38:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 75000 (157 MB) 2022-09-18 23:38:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 76000 (159 MB) 2022-09-18 23:39:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 77000 (161 MB) 2022-09-18 23:39:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 78000 (164 MB) 2022-09-18 23:40:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 79000 (166 MB) 2022-09-18 23:40:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 80000 (168 MB) 2022-09-18 23:41:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 81000 (170 MB) 2022-09-18 23:41:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 82000 (173 MB) 2022-09-18 23:42:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 83000 (175 MB) 2022-09-18 23:43:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 84000 (177 MB) 2022-09-18 23:43:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 85000 (179 MB) 2022-09-18 23:44:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 86000 (182 MB) 2022-09-18 23:44:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 87000 (184 MB) 2022-09-18 23:45:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 88000 (186 MB) 2022-09-18 23:45:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 89000 (189 MB) 2022-09-18 23:46:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 90000 (191 MB) 2022-09-18 23:46:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 91000 (193 MB) 2022-09-18 23:47:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 92000 (196 MB) 2022-09-18 23:47:23 destination > 2022-09-18 23:47:23 INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):93 - Flushing buffer of stream konnektivecrm_5_customers (200 MB) 2022-09-18 23:47:23 destination > 2022-09-18 23:47:23 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_customers (200 MB) to staging 2022-09-18 23:47:23 destination > 2022-09-18 23:47:23 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to a9c765cf-f43a-47f3-bb1a-107901e2704818314755321804265508.avro (200 MB) 2022-09-18 23:47:23 destination > 2022-09-18 23:47:23 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_customers (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-18 23:47:24 destination > 2022-09-18 23:47:24 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with full ID ABPnzm5T684yuS52xBtkDb-WdmWHR0aCM8Qboe-114Q_uFO9Tu3yP2n4p_G33vKLijcIHXs 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 7 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 1 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 5 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 6 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 8 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 3 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 2 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 4 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 10 containing 10.01 MB] 2022-09-18 23:47:26 destination > 2022-09-18 23:47:26 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 9 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 11 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 13 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 16 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 12 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 18 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 15 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 17 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 20 containing 9.89 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 19 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Finished uploading [Part number 14 containing 10.01 MB] 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5T6...KLijcIHXs]: Completed 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: a9c765cf-f43a-47f3-bb1a-107901e2704818314755321804265508.avro -> data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro (filename: 1.avro) 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data a9c765cf-f43a-47f3-bb1a-107901e2704818314755321804265508.avro 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_customers (current state: -315 bytes in 0 buffers) 2022-09-18 23:47:27 destination > 2022-09-18 23:47:27 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-18 23:47:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 93000 (198 MB) 2022-09-18 23:48:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 94000 (200 MB) 2022-09-18 23:48:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 95000 (202 MB) 2022-09-18 23:49:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 96000 (205 MB) 2022-09-18 23:49:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 97000 (207 MB) 2022-09-18 23:50:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 98000 (210 MB) 2022-09-18 23:50:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 99000 (212 MB) 2022-09-18 23:51:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 100000 (214 MB) 2022-09-18 23:51:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 101000 (217 MB) 2022-09-18 23:52:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 102000 (219 MB) 2022-09-18 23:53:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 103000 (221 MB) 2022-09-18 23:53:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 104000 (223 MB) 2022-09-18 23:54:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 105000 (226 MB) 2022-09-18 23:54:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 106000 (228 MB) 2022-09-18 23:55:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 107000 (230 MB) 2022-09-18 23:55:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 108000 (233 MB) 2022-09-18 23:56:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 109000 (235 MB) 2022-09-18 23:56:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 110000 (237 MB) 2022-09-18 23:57:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 111000 (239 MB) 2022-09-18 23:57:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 112000 (242 MB) 2022-09-18 23:58:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 113000 (244 MB) 2022-09-18 23:58:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 114000 (246 MB) 2022-09-18 23:59:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 115000 (249 MB) 2022-09-18 23:59:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 116000 (251 MB) 2022-09-19 00:00:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 117000 (254 MB) 2022-09-19 00:00:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 118000 (257 MB) 2022-09-19 00:01:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 119000 (259 MB) 2022-09-19 00:02:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 120000 (261 MB) 2022-09-19 00:02:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 121000 (264 MB) 2022-09-19 00:03:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 122000 (267 MB) 2022-09-19 00:03:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 123000 (269 MB) 2022-09-19 00:04:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 124000 (272 MB) 2022-09-19 00:04:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 125000 (275 MB) 2022-09-19 00:05:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 126000 (277 MB) 2022-09-19 00:05:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 127000 (280 MB) 2022-09-19 00:06:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 128000 (282 MB) 2022-09-19 00:06:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 129000 (285 MB) 2022-09-19 00:07:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 130000 (288 MB) 2022-09-19 00:07:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 131000 (290 MB) 2022-09-19 00:08:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 132000 (293 MB) 2022-09-19 00:09:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 133000 (296 MB) 2022-09-19 00:09:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 134000 (298 MB) 2022-09-19 00:10:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 135000 (301 MB) 2022-09-19 00:10:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 136000 (304 MB) 2022-09-19 00:11:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 137000 (307 MB) 2022-09-19 00:11:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 138000 (309 MB) 2022-09-19 00:12:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 139000 (312 MB) 2022-09-19 00:12:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 140000 (315 MB) 2022-09-19 00:13:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 141000 (317 MB) 2022-09-19 00:13:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 142000 (320 MB) 2022-09-19 00:14:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 143000 (323 MB) 2022-09-19 00:14:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 144000 (326 MB) 2022-09-19 00:15:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 145000 (329 MB) 2022-09-19 00:16:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 146000 (332 MB) 2022-09-19 00:16:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 147000 (335 MB) 2022-09-19 00:17:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 148000 (337 MB) 2022-09-19 00:17:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 149000 (340 MB) 2022-09-19 00:18:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 150000 (343 MB) 2022-09-19 00:18:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 151000 (346 MB) 2022-09-19 00:19:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 152000 (348 MB) 2022-09-19 00:19:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 153000 (351 MB) 2022-09-19 00:20:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 154000 (354 MB) 2022-09-19 00:20:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 155000 (357 MB) 2022-09-19 00:21:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 156000 (360 MB) 2022-09-19 00:22:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 157000 (362 MB) 2022-09-19 00:22:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 158000 (365 MB) 2022-09-19 00:23:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 159000 (368 MB) 2022-09-19 00:23:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 160000 (370 MB) 2022-09-19 00:24:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 161000 (373 MB) 2022-09-19 00:24:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 162000 (376 MB) 2022-09-19 00:25:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 163000 (379 MB) 2022-09-19 00:25:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 164000 (381 MB) 2022-09-19 00:26:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 165000 (384 MB) 2022-09-19 00:26:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 166000 (387 MB) 2022-09-19 00:27:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 167000 (390 MB) 2022-09-19 00:28:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 168000 (392 MB) 2022-09-19 00:28:20 destination > 2022-09-19 00:28:20 INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):93 - Flushing buffer of stream konnektivecrm_5_customers (200 MB) 2022-09-19 00:28:20 destination > 2022-09-19 00:28:20 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_customers (200 MB) to staging 2022-09-19 00:28:20 destination > 2022-09-19 00:28:20 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to ade708f8-d4f3-45df-8e17-e1e51261f68c9547798473276965686.avro (200 MB) 2022-09-19 00:28:20 destination > 2022-09-19 00:28:20 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_customers (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 00:28:21 destination > 2022-09-19 00:28:21 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with full ID ABPnzm6qtNX4J78hLu8m70KxKb3U5R-fAKgyRdYwTI3hru8AEEwuVOrCWmEqdXUEdRHAmBc 2022-09-19 00:28:21 destination > 2022-09-19 00:28:21 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 1 containing 10.01 MB] 2022-09-19 00:28:21 destination > 2022-09-19 00:28:21 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 3 containing 10.01 MB] 2022-09-19 00:28:21 destination > 2022-09-19 00:28:21 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 8 containing 10.01 MB] 2022-09-19 00:28:21 destination > 2022-09-19 00:28:21 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 2 containing 10.01 MB] 2022-09-19 00:28:21 destination > 2022-09-19 00:28:21 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 4 containing 10.01 MB] 2022-09-19 00:28:21 destination > 2022-09-19 00:28:21 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 7 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 5 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 6 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 15 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 9 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 11 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 10 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 13 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 16 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 14 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 12 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 18 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 17 containing 10.01 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 20 containing 9.86 MB] 2022-09-19 00:28:22 destination > 2022-09-19 00:28:22 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Finished uploading [Part number 19 containing 10.01 MB] 2022-09-19 00:28:23 destination > 2022-09-19 00:28:23 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm6qt...UEdRHAmBc]: Completed 2022-09-19 00:28:23 destination > 2022-09-19 00:28:23 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: ade708f8-d4f3-45df-8e17-e1e51261f68c9547798473276965686.avro -> data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro (filename: 2.avro) 2022-09-19 00:28:23 destination > 2022-09-19 00:28:23 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 2.avro 2022-09-19 00:28:23 destination > 2022-09-19 00:28:23 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data ade708f8-d4f3-45df-8e17-e1e51261f68c9547798473276965686.avro 2022-09-19 00:28:23 destination > 2022-09-19 00:28:23 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_customers (current state: -630 bytes in 0 buffers) 2022-09-19 00:28:23 destination > 2022-09-19 00:28:23 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-19 00:28:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 169000 (395 MB) 2022-09-19 00:29:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 170000 (397 MB) 2022-09-19 00:29:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 171000 (400 MB) 2022-09-19 00:30:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 172000 (403 MB) 2022-09-19 00:30:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 173000 (406 MB) 2022-09-19 00:31:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 174000 (408 MB) 2022-09-19 00:31:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 175000 (411 MB) 2022-09-19 00:32:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 176000 (414 MB) 2022-09-19 00:33:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 177000 (416 MB) 2022-09-19 00:33:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 178000 (419 MB) 2022-09-19 00:34:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 179000 (422 MB) 2022-09-19 00:34:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 180000 (424 MB) 2022-09-19 00:35:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 181000 (427 MB) 2022-09-19 00:35:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 182000 (430 MB) 2022-09-19 00:36:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 183000 (433 MB) 2022-09-19 00:36:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 184000 (436 MB) 2022-09-19 00:37:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 185000 (438 MB) 2022-09-19 00:37:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 186000 (441 MB) 2022-09-19 00:38:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 187000 (444 MB) 2022-09-19 00:39:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 188000 (446 MB) 2022-09-19 00:39:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 189000 (449 MB) 2022-09-19 00:40:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 190000 (452 MB) 2022-09-19 00:40:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 191000 (455 MB) 2022-09-19 00:41:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 192000 (458 MB) 2022-09-19 00:41:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 193000 (460 MB) 2022-09-19 00:42:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 194000 (463 MB) 2022-09-19 00:42:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 195000 (466 MB) 2022-09-19 00:43:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 196000 (469 MB) 2022-09-19 00:44:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 197000 (472 MB) 2022-09-19 00:44:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 198000 (474 MB) 2022-09-19 00:45:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 199000 (477 MB) 2022-09-19 00:45:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 200000 (480 MB) 2022-09-19 00:46:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 201000 (483 MB) 2022-09-19 00:46:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 202000 (486 MB) 2022-09-19 00:47:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 203000 (489 MB) 2022-09-19 00:48:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 204000 (492 MB) 2022-09-19 00:48:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 205000 (494 MB) 2022-09-19 00:49:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 206000 (497 MB) 2022-09-19 00:49:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 207000 (500 MB) 2022-09-19 00:50:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 208000 (503 MB) 2022-09-19 00:50:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 209000 (505 MB) 2022-09-19 00:51:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 210000 (508 MB) 2022-09-19 00:51:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 211000 (511 MB) 2022-09-19 00:52:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 212000 (514 MB) 2022-09-19 00:53:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 213000 (517 MB) 2022-09-19 00:53:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 214000 (520 MB) 2022-09-19 00:54:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 215000 (523 MB) 2022-09-19 00:54:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 216000 (525 MB) 2022-09-19 00:55:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 217000 (528 MB) 2022-09-19 00:55:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 218000 (531 MB) 2022-09-19 00:56:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 219000 (534 MB) 2022-09-19 00:56:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 220000 (536 MB) 2022-09-19 00:57:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 221000 (539 MB) 2022-09-19 00:58:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 222000 (542 MB) 2022-09-19 00:58:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 223000 (545 MB) 2022-09-19 00:59:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 224000 (548 MB) 2022-09-19 00:59:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 225000 (550 MB) 2022-09-19 01:00:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 226000 (553 MB) 2022-09-19 01:00:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 227000 (556 MB) 2022-09-19 01:01:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 228000 (559 MB) 2022-09-19 01:02:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 229000 (562 MB) 2022-09-19 01:02:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 230000 (564 MB) 2022-09-19 01:03:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 231000 (567 MB) 2022-09-19 01:03:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 232000 (570 MB) 2022-09-19 01:04:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 233000 (573 MB) 2022-09-19 01:04:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 234000 (576 MB) 2022-09-19 01:05:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 235000 (579 MB) 2022-09-19 01:06:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 236000 (582 MB) 2022-09-19 01:06:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 237000 (585 MB) 2022-09-19 01:07:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 238000 (588 MB) 2022-09-19 01:07:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 239000 (590 MB) 2022-09-19 01:07:53 destination > 2022-09-19 01:07:53 INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):93 - Flushing buffer of stream konnektivecrm_5_customers (200 MB) 2022-09-19 01:07:53 destination > 2022-09-19 01:07:53 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_customers (200 MB) to staging 2022-09-19 01:07:53 destination > 2022-09-19 01:07:53 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to f670a062-a4b8-4f23-9913-f67579640a5015649683909186261474.avro (200 MB) 2022-09-19 01:07:53 destination > 2022-09-19 01:07:53 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_customers (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 01:07:53 destination > 2022-09-19 01:07:53 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with full ID ABPnzm7FQKuf0CzVSLFIWV7p4TkpNP4LzN8aUDnowTzSkhBAimx_5nbNmpKPRQpyrcLrg98 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 1 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 3 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 2 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 4 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 7 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 5 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 6 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 10 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 8 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 9 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 12 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 14 containing 10.01 MB] 2022-09-19 01:07:54 destination > 2022-09-19 01:07:54 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 16 containing 10.01 MB] 2022-09-19 01:07:55 destination > 2022-09-19 01:07:55 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 15 containing 10.01 MB] 2022-09-19 01:07:55 destination > 2022-09-19 01:07:55 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 17 containing 10.01 MB] 2022-09-19 01:07:55 destination > 2022-09-19 01:07:55 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 18 containing 10.01 MB] 2022-09-19 01:07:55 destination > 2022-09-19 01:07:55 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 20 containing 9.88 MB] 2022-09-19 01:07:55 destination > 2022-09-19 01:07:55 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 19 containing 10.01 MB] 2022-09-19 01:07:56 destination > 2022-09-19 01:07:56 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 11 containing 10.01 MB] 2022-09-19 01:07:56 destination > 2022-09-19 01:07:56 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Finished uploading [Part number 13 containing 10.01 MB] 2022-09-19 01:07:56 destination > 2022-09-19 01:07:56 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm7FQ...pyrcLrg98]: Completed 2022-09-19 01:07:56 destination > 2022-09-19 01:07:56 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: f670a062-a4b8-4f23-9913-f67579640a5015649683909186261474.avro -> data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro (filename: 3.avro) 2022-09-19 01:07:56 destination > 2022-09-19 01:07:56 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 3.avro 2022-09-19 01:07:56 destination > 2022-09-19 01:07:56 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data f670a062-a4b8-4f23-9913-f67579640a5015649683909186261474.avro 2022-09-19 01:07:56 destination > 2022-09-19 01:07:56 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_customers (current state: -945 bytes in 0 buffers) 2022-09-19 01:07:56 destination > 2022-09-19 01:07:56 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-19 01:08:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 240000 (593 MB) 2022-09-19 01:08:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 241000 (596 MB) 2022-09-19 01:09:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 242000 (599 MB) 2022-09-19 01:10:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 243000 (601 MB) 2022-09-19 01:10:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 244000 (604 MB) 2022-09-19 01:11:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 245000 (607 MB) 2022-09-19 01:11:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 246000 (609 MB) 2022-09-19 01:12:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 247000 (612 MB) 2022-09-19 01:12:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 248000 (615 MB) 2022-09-19 01:13:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 249000 (618 MB) 2022-09-19 01:14:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 250000 (621 MB) 2022-09-19 01:14:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 251000 (624 MB) 2022-09-19 01:15:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 252000 (626 MB) 2022-09-19 01:15:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 253000 (630 MB) 2022-09-19 01:16:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 254000 (632 MB) 2022-09-19 01:16:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 255000 (635 MB) 2022-09-19 01:17:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 256000 (638 MB) 2022-09-19 01:18:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 257000 (641 MB) 2022-09-19 01:18:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 258000 (644 MB) 2022-09-19 01:19:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 259000 (647 MB) 2022-09-19 01:19:20 source > Read 215920 records from customers stream 2022-09-19 01:19:20 source > Finished syncing customers 2022-09-19 01:19:20 source > SourceKonnektivecrm runtimes: Syncing stream customers 2:19:08.283675 2022-09-19 01:19:20 source > Syncing stream: order 2022-09-19 01:19:50 destination > 2022-09-19 01:19:50 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_order (current state: 56 MB in 1 buffers) 2022-09-19 01:19:50 destination > 2022-09-19 01:19:50 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-19 01:21:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 260000 (649 MB) 2022-09-19 01:23:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 261000 (651 MB) 2022-09-19 01:25:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 262000 (653 MB) 2022-09-19 01:27:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 263000 (655 MB) 2022-09-19 01:29:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 264000 (658 MB) 2022-09-19 01:31:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 265000 (660 MB) 2022-09-19 01:34:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 266000 (662 MB) 2022-09-19 01:36:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 267000 (665 MB) 2022-09-19 01:38:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 268000 (667 MB) 2022-09-19 01:40:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 269000 (669 MB) 2022-09-19 01:42:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 270000 (671 MB) 2022-09-19 01:44:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 271000 (674 MB) 2022-09-19 01:46:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 272000 (676 MB) 2022-09-19 01:48:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 273000 (678 MB) 2022-09-19 01:51:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 274000 (680 MB) 2022-09-19 01:53:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 275000 (682 MB) 2022-09-19 01:54:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 276000 (684 MB) 2022-09-19 01:56:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 277000 (686 MB) 2022-09-19 01:59:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 278000 (688 MB) 2022-09-19 02:01:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 279000 (690 MB) 2022-09-19 02:03:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 280000 (692 MB) 2022-09-19 02:05:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 281000 (694 MB) 2022-09-19 02:07:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 282000 (696 MB) 2022-09-19 02:09:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 283000 (698 MB) 2022-09-19 02:12:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 284000 (700 MB) 2022-09-19 02:14:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 285000 (702 MB) 2022-09-19 02:16:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 286000 (704 MB) 2022-09-19 02:18:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 287000 (706 MB) 2022-09-19 02:20:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 288000 (708 MB) 2022-09-19 02:22:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 289000 (710 MB) 2022-09-19 02:25:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 290000 (712 MB) 2022-09-19 02:27:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 291000 (714 MB) 2022-09-19 02:29:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 292000 (716 MB) 2022-09-19 02:31:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 293000 (718 MB) 2022-09-19 02:33:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 294000 (720 MB) 2022-09-19 02:35:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 295000 (722 MB) 2022-09-19 02:37:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 296000 (724 MB) 2022-09-19 02:39:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 297000 (726 MB) 2022-09-19 02:42:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 298000 (728 MB) 2022-09-19 02:44:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 299000 (730 MB) 2022-09-19 02:46:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 300000 (732 MB) 2022-09-19 02:48:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 301000 (734 MB) 2022-09-19 02:50:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 302000 (736 MB) 2022-09-19 02:52:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 303000 (738 MB) 2022-09-19 02:55:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 304000 (740 MB) 2022-09-19 02:57:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 305000 (742 MB) 2022-09-19 02:59:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 306000 (744 MB) 2022-09-19 03:01:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 307000 (746 MB) 2022-09-19 03:03:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 308000 (748 MB) 2022-09-19 03:05:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 309000 (750 MB) 2022-09-19 03:08:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 310000 (752 MB) 2022-09-19 03:10:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 311000 (754 MB) 2022-09-19 03:12:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 312000 (755 MB) 2022-09-19 03:14:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 313000 (757 MB) 2022-09-19 03:16:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 314000 (759 MB) 2022-09-19 03:18:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 315000 (761 MB) 2022-09-19 03:20:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 316000 (763 MB) 2022-09-19 03:23:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 317000 (765 MB) 2022-09-19 03:25:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 318000 (767 MB) 2022-09-19 03:27:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 319000 (769 MB) 2022-09-19 03:29:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 320000 (771 MB) 2022-09-19 03:31:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 321000 (773 MB) 2022-09-19 03:34:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 322000 (775 MB) 2022-09-19 03:36:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 323000 (777 MB) 2022-09-19 03:38:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 324000 (779 MB) 2022-09-19 03:40:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 325000 (781 MB) 2022-09-19 03:42:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 326000 (783 MB) 2022-09-19 03:44:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 327000 (785 MB) 2022-09-19 03:47:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 328000 (787 MB) 2022-09-19 03:49:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 329000 (789 MB) 2022-09-19 03:51:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 330000 (791 MB) 2022-09-19 03:52:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 331000 (793 MB) 2022-09-19 03:55:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 332000 (795 MB) 2022-09-19 03:57:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 333000 (797 MB) 2022-09-19 03:59:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 334000 (799 MB) 2022-09-19 04:01:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 335000 (801 MB) 2022-09-19 04:03:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 336000 (803 MB) 2022-09-19 04:05:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 337000 (805 MB) 2022-09-19 04:08:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 338000 (808 MB) 2022-09-19 04:10:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 339000 (810 MB) 2022-09-19 04:12:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 340000 (812 MB) 2022-09-19 04:14:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 341000 (814 MB) 2022-09-19 04:16:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 342000 (816 MB) 2022-09-19 04:18:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 343000 (818 MB) 2022-09-19 04:20:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 344000 (820 MB) 2022-09-19 04:22:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 345000 (822 MB) 2022-09-19 04:25:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 346000 (824 MB) 2022-09-19 04:27:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 347000 (826 MB) 2022-09-19 04:29:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 348000 (828 MB) 2022-09-19 04:31:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 349000 (830 MB) 2022-09-19 04:33:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 350000 (832 MB) 2022-09-19 04:35:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 351000 (834 MB) 2022-09-19 04:37:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 352000 (836 MB) 2022-09-19 04:39:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 353000 (838 MB) 2022-09-19 04:41:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 354000 (840 MB) 2022-09-19 04:43:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 355000 (842 MB) 2022-09-19 04:45:18 destination > 2022-09-19 04:45:18 INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):93 - Flushing buffer of stream konnektivecrm_5_order (200 MB) 2022-09-19 04:45:18 destination > 2022-09-19 04:45:18 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_order (200 MB) to staging 2022-09-19 04:45:18 destination > 2022-09-19 04:45:18 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to f74341d5-5828-4c70-b520-6fe8e903eac711287993177484645915.avro (200 MB) 2022-09-19 04:45:18 destination > 2022-09-19 04:45:18 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_order (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 04:45:18 destination > 2022-09-19 04:45:18 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with full ID ABPnzm7pjClWNiKPAsYRxGe8rEYYeFaHAbN6OIsWiVA2OVrmI3cCRzxuMe-20WE1W5CIwac 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 1 containing 10.01 MB] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 2 containing 10.01 MB] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 3 containing 10.01 MB] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 4 containing 10.01 MB] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 5 containing 10.01 MB] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 7 containing 10.01 MB] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 6 containing 10.01 MB] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 10 containing 10.01 MB] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-19 04:45:19 destination > 2022-09-19 04:45:19 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 9 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 8 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 11 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 13 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 12 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 14 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 15 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 18 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 16 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 19 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 20 containing 9.90 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Finished uploading [Part number 17 containing 10.01 MB] 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm7pj...E1W5CIwac]: Completed 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: f74341d5-5828-4c70-b520-6fe8e903eac711287993177484645915.avro -> data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro (filename: 1.avro) 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data f74341d5-5828-4c70-b520-6fe8e903eac711287993177484645915.avro 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_order (current state: 56 MB in 1 buffers) 2022-09-19 04:45:20 destination > 2022-09-19 04:45:20 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-19 04:45:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 356000 (844 MB) 2022-09-19 04:47:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 357000 (846 MB) 2022-09-19 04:50:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 358000 (848 MB) 2022-09-19 04:52:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 359000 (850 MB) 2022-09-19 04:54:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 360000 (852 MB) 2022-09-19 04:56:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 361000 (855 MB) 2022-09-19 04:58:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 362000 (857 MB) 2022-09-19 05:00:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 363000 (859 MB) 2022-09-19 05:02:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 364000 (861 MB) 2022-09-19 05:04:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 365000 (863 MB) 2022-09-19 05:06:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 366000 (865 MB) 2022-09-19 05:08:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 367000 (867 MB) 2022-09-19 05:11:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 368000 (869 MB) 2022-09-19 05:13:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 369000 (871 MB) 2022-09-19 05:15:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 370000 (873 MB) 2022-09-19 05:17:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 371000 (875 MB) 2022-09-19 05:19:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 372000 (877 MB) 2022-09-19 05:21:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 373000 (879 MB) 2022-09-19 05:23:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 374000 (881 MB) 2022-09-19 05:25:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 375000 (883 MB) 2022-09-19 05:28:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 376000 (885 MB) 2022-09-19 05:30:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 377000 (887 MB) 2022-09-19 05:32:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 378000 (889 MB) 2022-09-19 05:34:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 379000 (891 MB) 2022-09-19 05:36:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 380000 (893 MB) 2022-09-19 05:38:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 381000 (895 MB) 2022-09-19 05:41:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 382000 (897 MB) 2022-09-19 05:43:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 383000 (899 MB) 2022-09-19 05:45:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 384000 (901 MB) 2022-09-19 05:47:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 385000 (903 MB) 2022-09-19 05:49:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 386000 (905 MB) 2022-09-19 05:51:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 387000 (907 MB) 2022-09-19 05:54:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 388000 (909 MB) 2022-09-19 05:56:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 389000 (911 MB) 2022-09-19 05:58:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 390000 (913 MB) 2022-09-19 06:00:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 391000 (915 MB) 2022-09-19 06:02:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 392000 (917 MB) 2022-09-19 06:04:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 393000 (920 MB) 2022-09-19 06:07:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 394000 (922 MB) 2022-09-19 06:09:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 395000 (924 MB) 2022-09-19 06:11:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 396000 (926 MB) 2022-09-19 06:13:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 397000 (928 MB) 2022-09-19 06:15:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 398000 (930 MB) 2022-09-19 06:17:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 399000 (932 MB) 2022-09-19 06:20:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 400000 (934 MB) 2022-09-19 06:22:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 401000 (936 MB) 2022-09-19 06:24:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 402000 (938 MB) 2022-09-19 06:26:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 403000 (940 MB) 2022-09-19 06:28:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 404000 (942 MB) 2022-09-19 06:30:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 405000 (944 MB) 2022-09-19 06:33:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 406000 (946 MB) 2022-09-19 06:35:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 407000 (948 MB) 2022-09-19 06:37:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 408000 (950 MB) 2022-09-19 06:39:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 409000 (952 MB) 2022-09-19 06:41:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 410000 (954 MB) 2022-09-19 06:43:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 411000 (956 MB) 2022-09-19 06:46:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 412000 (958 MB) 2022-09-19 06:48:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 413000 (960 MB) 2022-09-19 06:50:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 414000 (962 MB) 2022-09-19 06:52:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 415000 (964 MB) 2022-09-19 06:54:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 416000 (966 MB) 2022-09-19 06:56:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 417000 (968 MB) 2022-09-19 06:59:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 418000 (970 MB) 2022-09-19 07:01:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 419000 (972 MB) 2022-09-19 07:03:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 420000 (974 MB) 2022-09-19 07:05:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 421000 (976 MB) 2022-09-19 07:08:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 422000 (979 MB) 2022-09-19 07:10:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 423000 (981 MB) 2022-09-19 07:12:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 424000 (983 MB) 2022-09-19 07:14:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 425000 (985 MB) 2022-09-19 07:17:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 426000 (987 MB) 2022-09-19 07:19:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 427000 (989 MB) 2022-09-19 07:21:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 428000 (991 MB) 2022-09-19 07:23:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 429000 (993 MB) 2022-09-19 07:26:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 430000 (995 MB) 2022-09-19 07:28:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 431000 (997 MB) 2022-09-19 07:30:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 432000 (999 MB) 2022-09-19 07:32:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 433000 (1001 MB) 2022-09-19 07:34:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 434000 (1003 MB) 2022-09-19 07:36:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 435000 (1005 MB) 2022-09-19 07:39:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 436000 (1007 MB) 2022-09-19 07:41:14 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 437000 (1009 MB) 2022-09-19 07:43:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 438000 (1011 MB) 2022-09-19 07:45:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 439000 (1013 MB) 2022-09-19 07:47:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 440000 (1015 MB) 2022-09-19 07:49:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 441000 (1017 MB) 2022-09-19 07:52:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 442000 (1019 MB) 2022-09-19 07:54:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 443000 (1021 MB) 2022-09-19 07:56:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 444000 (1023 MB) 2022-09-19 07:58:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 445000 (1 GB) 2022-09-19 08:00:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 446000 (1 GB) 2022-09-19 08:02:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 447000 (1 GB) 2022-09-19 08:05:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 448000 (1 GB) 2022-09-19 08:07:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 449000 (1 GB) 2022-09-19 08:09:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 450000 (1 GB) 2022-09-19 08:11:30 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 451000 (1 GB) 2022-09-19 08:13:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 452000 (1 GB) 2022-09-19 08:14:44 destination > 2022-09-19 08:14:44 INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):93 - Flushing buffer of stream konnektivecrm_5_order (200 MB) 2022-09-19 08:14:44 destination > 2022-09-19 08:14:44 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_order (200 MB) to staging 2022-09-19 08:14:44 destination > 2022-09-19 08:14:44 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 96684a52-15b0-4200-891c-d29389cdbf4213386372775446639843.avro (200 MB) 2022-09-19 08:14:44 destination > 2022-09-19 08:14:44 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_order (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 08:14:44 destination > 2022-09-19 08:14:44 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with full ID ABPnzm4W11tCJCiOs_iHpQOZw4MsCv8MCLrdhHak0qP3fhaKo-X2Dzz9JNIS61KZ-Muvpz4 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 1 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 2 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 3 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 4 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 5 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 7 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 6 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 8 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 10 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 9 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 11 containing 10.01 MB] 2022-09-19 08:14:45 destination > 2022-09-19 08:14:45 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 12 containing 10.01 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 13 containing 10.01 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 16 containing 10.01 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 14 containing 10.01 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 17 containing 10.01 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 15 containing 10.01 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 18 containing 10.01 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 20 containing 9.85 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Finished uploading [Part number 19 containing 10.01 MB] 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro with id ABPnzm4W1...KZ-Muvpz4]: Completed 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 96684a52-15b0-4200-891c-d29389cdbf4213386372775446639843.avro -> data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro (filename: 2.avro) 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 2.avro 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 96684a52-15b0-4200-891c-d29389cdbf4213386372775446639843.avro 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_order (current state: 56 MB in 1 buffers) 2022-09-19 08:14:46 destination > 2022-09-19 08:14:46 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-19 08:15:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 453000 (1 GB) 2022-09-19 08:18:25 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 454000 (1 GB) 2022-09-19 08:20:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 455000 (1 GB) 2022-09-19 08:22:26 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 456000 (1 GB) 2022-09-19 08:24:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 457000 (1 GB) 2022-09-19 08:26:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 458000 (1 GB) 2022-09-19 08:28:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 459000 (1 GB) 2022-09-19 08:31:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 460000 (1 GB) 2022-09-19 08:33:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 461000 (1 GB) 2022-09-19 08:35:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 462000 (1 GB) 2022-09-19 08:37:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 463000 (1 GB) 2022-09-19 08:39:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 464000 (1 GB) 2022-09-19 08:42:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 465000 (1 GB) 2022-09-19 08:44:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 466000 (1 GB) 2022-09-19 08:46:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 467000 (1 GB) 2022-09-19 08:48:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 468000 (1 GB) 2022-09-19 08:50:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 469000 (1 GB) 2022-09-19 08:52:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 470000 (1 GB) 2022-09-19 08:54:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 471000 (1 GB) 2022-09-19 08:57:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 472000 (1 GB) 2022-09-19 08:59:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 473000 (1 GB) 2022-09-19 09:01:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 474000 (1 GB) 2022-09-19 09:03:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 475000 (1 GB) 2022-09-19 09:05:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 476000 (1 GB) 2022-09-19 09:07:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 477000 (1 GB) 2022-09-19 09:10:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 478000 (1 GB) 2022-09-19 09:12:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 479000 (1 GB) 2022-09-19 09:15:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 480000 (1 GB) 2022-09-19 09:17:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 481000 (1 GB) 2022-09-19 09:19:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 482000 (1 GB) 2022-09-19 09:21:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 483000 (1 GB) 2022-09-19 09:24:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 484000 (1 GB) 2022-09-19 09:26:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 485000 (1 GB) 2022-09-19 09:28:38 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 486000 (1 GB) 2022-09-19 09:30:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 487000 (1 GB) 2022-09-19 09:32:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 488000 (1 GB) 2022-09-19 09:35:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 489000 (1 GB) 2022-09-19 09:37:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 490000 (1 GB) 2022-09-19 09:39:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 491000 (1 GB) 2022-09-19 09:42:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 492000 (1 GB) 2022-09-19 09:44:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 493000 (1 GB) 2022-09-19 09:46:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 494000 (1 GB) 2022-09-19 09:48:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 495000 (1 GB) 2022-09-19 09:51:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 496000 (1 GB) 2022-09-19 09:53:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 497000 (1 GB) 2022-09-19 09:55:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 498000 (1 GB) 2022-09-19 09:57:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 499000 (1 GB) 2022-09-19 09:59:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 500000 (1 GB) 2022-09-19 10:01:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 501000 (1 GB) 2022-09-19 10:04:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 502000 (1 GB) 2022-09-19 10:06:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 503000 (1 GB) 2022-09-19 10:08:48 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 504000 (1 GB) 2022-09-19 10:10:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 505000 (1 GB) 2022-09-19 10:12:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 506000 (1 GB) 2022-09-19 10:14:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 507000 (1 GB) 2022-09-19 10:17:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 508000 (1 GB) 2022-09-19 10:19:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 509000 (1 GB) 2022-09-19 10:22:03 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 510000 (1 GB) 2022-09-19 10:24:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 511000 (1 GB) 2022-09-19 10:26:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 512000 (1 GB) 2022-09-19 10:28:22 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 513000 (1 GB) 2022-09-19 10:30:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 514000 (1 GB) 2022-09-19 10:32:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 515000 (1 GB) 2022-09-19 10:34:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 516000 (1 GB) 2022-09-19 10:36:59 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 517000 (1 GB) 2022-09-19 10:39:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 518000 (1 GB) 2022-09-19 10:41:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 519000 (1 GB) 2022-09-19 10:43:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 520000 (1 GB) 2022-09-19 10:45:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 521000 (1 GB) 2022-09-19 10:48:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 522000 (1 GB) 2022-09-19 10:50:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 523000 (1 GB) 2022-09-19 10:52:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 524000 (1 GB) 2022-09-19 10:54:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 525000 (1 GB) 2022-09-19 10:57:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 526000 (1 GB) 2022-09-19 10:59:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 527000 (1 GB) 2022-09-19 11:02:01 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 528000 (1 GB) 2022-09-19 11:04:08 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 529000 (1 GB) 2022-09-19 11:06:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 530000 (1 GB) 2022-09-19 11:08:49 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 531000 (1 GB) 2022-09-19 11:11:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 532000 (1 GB) 2022-09-19 11:13:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 533000 (1 GB) 2022-09-19 11:16:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 534000 (1 GB) 2022-09-19 11:18:28 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 535000 (1 GB) 2022-09-19 11:20:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 536000 (1 GB) 2022-09-19 11:23:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 537000 (1 GB) 2022-09-19 11:26:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 538000 (1 GB) 2022-09-19 11:28:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 539000 (1 GB) 2022-09-19 11:30:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 540000 (1 GB) 2022-09-19 11:32:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 541000 (1 GB) 2022-09-19 11:35:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 542000 (1 GB) 2022-09-19 11:37:29 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 543000 (1 GB) 2022-09-19 11:40:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 544000 (1 GB) 2022-09-19 11:42:35 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 545000 (1 GB) 2022-09-19 11:44:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 546000 (1 GB) 2022-09-19 11:47:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 547000 (1 GB) 2022-09-19 11:49:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 548000 (1 GB) 2022-09-19 11:51:23 destination > 2022-09-19 11:51:23 INFO i.a.i.d.r.SerializedBufferingStrategy(flushWriter):93 - Flushing buffer of stream konnektivecrm_5_order (200 MB) 2022-09-19 11:51:23 destination > 2022-09-19 11:51:23 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_order (200 MB) to staging 2022-09-19 11:51:23 destination > 2022-09-19 11:51:23 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to bcdd4fa6-579d-40d2-b6a6-7d0c3201db6a18407103879736680521.avro (200 MB) 2022-09-19 11:51:23 destination > 2022-09-19 11:51:23 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_order (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 11:51:23 destination > 2022-09-19 11:51:23 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with full ID ABPnzm6l54ob42eSfC26f1dh6J_Y1lkMm3jFviHA6owNshzj6jbHC7F_onb0NuPMBq4Lsyw 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 1 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 3 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 2 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 4 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 6 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 5 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 8 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 7 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 9 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 10 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 12 containing 10.01 MB] 2022-09-19 11:51:24 destination > 2022-09-19 11:51:24 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 11 containing 10.01 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 13 containing 10.01 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 14 containing 10.01 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 15 containing 10.01 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 16 containing 10.01 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 17 containing 10.01 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 18 containing 10.01 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 19 containing 10.01 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Finished uploading [Part number 20 containing 9.86 MB] 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro with id ABPnzm6l5...PMBq4Lsyw]: Completed 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: bcdd4fa6-579d-40d2-b6a6-7d0c3201db6a18407103879736680521.avro -> data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro (filename: 3.avro) 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 3.avro 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data bcdd4fa6-579d-40d2-b6a6-7d0c3201db6a18407103879736680521.avro 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_order (current state: 56 MB in 1 buffers) 2022-09-19 11:51:25 destination > 2022-09-19 11:51:25 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-19 11:51:58 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 549000 (1 GB) 2022-09-19 11:54:45 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 550000 (1 GB) 2022-09-19 11:56:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 551000 (1 GB) 2022-09-19 11:59:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 552000 (1 GB) 2022-09-19 12:01:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 553000 (1 GB) 2022-09-19 12:03:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 554000 (1 GB) 2022-09-19 12:06:13 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 555000 (1 GB) 2022-09-19 12:08:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 556000 (1 GB) 2022-09-19 12:11:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 557000 (1 GB) 2022-09-19 12:13:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 558000 (1 GB) 2022-09-19 12:15:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 559000 (1 GB) 2022-09-19 12:18:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 560000 (1 GB) 2022-09-19 12:20:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 561000 (1 GB) 2022-09-19 12:22:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 562000 (1 GB) 2022-09-19 12:25:10 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 563000 (1 GB) 2022-09-19 12:27:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 564000 (1 GB) 2022-09-19 12:29:37 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 565000 (1 GB) 2022-09-19 12:31:51 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 566000 (1 GB) 2022-09-19 12:33:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 567000 (1 GB) 2022-09-19 12:36:34 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 568000 (1 GB) 2022-09-19 12:38:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 569000 (1 GB) 2022-09-19 12:41:06 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 570000 (1 GB) 2022-09-19 12:43:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 571000 (1 GB) 2022-09-19 12:45:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 572000 (1 GB) 2022-09-19 12:47:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 573000 (1 GB) 2022-09-19 12:50:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 574000 (1 GB) 2022-09-19 12:52:27 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 575000 (1 GB) 2022-09-19 12:54:42 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 576000 (1 GB) 2022-09-19 12:56:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 577000 (1 GB) 2022-09-19 12:59:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 578000 (1 GB) 2022-09-19 13:01:11 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 579000 (1 GB) 2022-09-19 13:03:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 580000 (1 GB) 2022-09-19 13:06:09 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 581000 (1 GB) 2022-09-19 13:08:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 582000 (1 GB) 2022-09-19 13:10:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 583000 (1 GB) 2022-09-19 13:12:50 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 584000 (1 GB) 2022-09-19 13:14:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 585000 (1 GB) 2022-09-19 13:17:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 586000 (1 GB) 2022-09-19 13:19:40 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 587000 (1 GB) 2022-09-19 13:21:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 588000 (1 GB) 2022-09-19 13:24:15 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 589000 (1 GB) 2022-09-19 13:26:33 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 590000 (1 GB) 2022-09-19 13:28:41 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 591000 (1 GB) 2022-09-19 13:31:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 592000 (1 GB) 2022-09-19 13:33:44 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 593000 (1 GB) 2022-09-19 13:35:57 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 594000 (1 GB) 2022-09-19 13:38:12 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 595000 (1 GB) 2022-09-19 13:40:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 596000 (1 GB) 2022-09-19 13:42:31 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 597000 (1 GB) 2022-09-19 13:45:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 598000 (1 GB) 2022-09-19 13:47:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 599000 (1 GB) 2022-09-19 13:49:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 600000 (1 GB) 2022-09-19 13:52:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 601000 (1 GB) 2022-09-19 13:54:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 602000 (1 GB) 2022-09-19 13:54:50 source > Read 286000 records from order stream 2022-09-19 13:54:50 source > Finished syncing order 2022-09-19 13:54:50 source > SourceKonnektivecrm runtimes: Syncing stream customers 2:19:08.283675 Syncing stream order 12:35:30.256796 2022-09-19 13:54:50 source > Syncing stream: transactions 2022-09-19 13:54:50 source > Setting state of transactions stream to {'dateCreated': '2022-09-17 23:56:21'} 2022-09-19 13:54:51 destination > 2022-09-19 13:54:51 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$addRecord$0):48 - Starting a new buffer for stream konnektivecrm_5_transactions (current state: 168 MB in 2 buffers) 2022-09-19 13:54:51 destination > 2022-09-19 13:54:51 INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 - Default schema. 2022-09-19 13:54:54 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 603000 (1 GB) 2022-09-19 13:55:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 604000 (1 GB) 2022-09-19 13:55:05 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):352 - Records read: 605000 (1 GB) 2022-09-19 13:55:07 source > Read 2614 records from transactions stream 2022-09-19 13:55:07 source > Finished syncing transactions 2022-09-19 13:55:07 source > SourceKonnektivecrm runtimes: Syncing stream customers 2:19:08.283675 Syncing stream order 12:35:30.256796 Syncing stream transactions 0:00:16.737554 2022-09-19 13:55:07 source > Finished syncing SourceKonnektivecrm 2022-09-19 13:55:07 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):363 - Total records read: 605443 (1 GB) 2022-09-19 13:55:07 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):366 - Schema validation errors found for stream customers. Error messages: [$.customerId is of an incorrect type. Expected it to be [null, string], $.paySources is of an incorrect type. Expected it to be [null, object], $.customFields is of an incorrect type. Expected it to be [null, object], $.billShipSame is of an incorrect type. Expected it to be [null, string], $.paySourceId is of an incorrect type. Expected it to be [null, string], $.notes is of an incorrect type. Expected it to be [null, object], $.contactOptIn is of an incorrect type. Expected it to be [null, string]] 2022-09-19 13:55:07 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):366 - Schema validation errors found for stream transactions. Error messages: [$.transactionId is of an incorrect type. Expected it to be [null, string], $.customerId is of an incorrect type. Expected it to be [null, string], $.merchantId is of an incorrect type. Expected it to be [null, string], $.isChargedback is of an incorrect type. Expected it to be [null, string], $.billingCycleNumber is of an incorrect type. Expected it to be [null, string], $.cardIsDebit is of an incorrect type. Expected it to be [null, string], $.cardIsPrepaid is of an incorrect type. Expected it to be [null, string], $.parentTxnId is of an incorrect type. Expected it to be [null, string], $.items is of an incorrect type. Expected it to be [null, object]] 2022-09-19 13:55:07 WARN i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$5):366 - Schema validation errors found for stream order. Error messages: [$.customerId is of an incorrect type. Expected it to be [null, string], $.agentUserId is of an incorrect type. Expected it to be [null, string], $.campaignId is of an incorrect type. Expected it to be [null, string], $.isDeclineSave is of an incorrect type. Expected it to be [null, string], $.fulfillments is of an incorrect type. Expected it to be [null, object], $.cardIsDebit is of an incorrect type. Expected it to be [null, string], $.cardIsPrepaid is of an incorrect type. Expected it to be [null, string], $.hasUpsell is of an incorrect type. Expected it to be [null, string]] 2022-09-19 13:55:07 INFO i.a.w.g.DefaultReplicationWorker(run):182 - One of source or destination thread complete. Waiting on the other. 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO i.a.i.d.b.BufferedStreamConsumer(close):171 - executing on success close procedure. 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO i.a.i.d.r.SerializedBufferingStrategy(flushAll):103 - Flushing all 3 current buffers (173 MB in total) 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):106 - Flushing buffer of stream konnektivecrm_5_transactions (4 MB) 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_transactions (4 MB) to staging 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 517f359c-ff5a-4d36-beba-ff69d18e92f916083570233439575344.avro (4 MB) 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_transactions (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with full ID ABPnzm5HonkWqvPb3mk2VC5_F1TyBC1P3dRaxQNLzTLxX-Ipa2Z4KglzKtZvaiaS1rbBHaU 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-19 13:55:07 destination > 2022-09-19 13:55:07 INFO a.m.s.StreamTransferManager(complete):367 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5Ho...aS1rbBHaU]: Uploading leftover stream [Part number 1 containing 4.82 MB] 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5Ho...aS1rbBHaU]: Finished uploading [Part number 1 containing 4.82 MB] 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro with id ABPnzm5Ho...aS1rbBHaU]: Completed 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 517f359c-ff5a-4d36-beba-ff69d18e92f916083570233439575344.avro -> data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro (filename: 1.avro) 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 1.avro 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 517f359c-ff5a-4d36-beba-ff69d18e92f916083570233439575344.avro 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):106 - Flushing buffer of stream konnektivecrm_5_customers (56 MB) 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_customers (56 MB) to staging 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 122d8509-973b-4cc4-bd3f-cf9f6bf7ac4514220950526129827488.avro (56 MB) 2022-09-19 13:55:09 destination > 2022-09-19 13:55:09 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_customers (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 13:55:10 destination > 2022-09-19 13:55:10 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with full ID ABPnzm60EGdgeMAoribqVGRrWDJo5bh-13Mx42Rv4JgLMxuIukvbxfSdmYD2ym9y_VHfK88 2022-09-19 13:55:10 destination > 2022-09-19 13:55:10 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm60E...9y_VHfK88]: Finished uploading [Part number 1 containing 10.01 MB] 2022-09-19 13:55:10 destination > 2022-09-19 13:55:10 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-19 13:55:10 destination > 2022-09-19 13:55:10 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm60E...9y_VHfK88]: Finished uploading [Part number 2 containing 10.01 MB] 2022-09-19 13:55:10 destination > 2022-09-19 13:55:10 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm60E...9y_VHfK88]: Finished uploading [Part number 3 containing 10.01 MB] 2022-09-19 13:55:10 destination > 2022-09-19 13:55:10 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm60E...9y_VHfK88]: Finished uploading [Part number 4 containing 10.01 MB] 2022-09-19 13:55:10 destination > 2022-09-19 13:55:10 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm60E...9y_VHfK88]: Finished uploading [Part number 5 containing 10.01 MB] 2022-09-19 13:55:10 destination > 2022-09-19 13:55:10 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm60E...9y_VHfK88]: Finished uploading [Part number 6 containing 6.77 MB] 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm60E...9y_VHfK88]: Completed 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 122d8509-973b-4cc4-bd3f-cf9f6bf7ac4514220950526129827488.avro -> data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro (filename: 4.avro) 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 4.avro 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 122d8509-973b-4cc4-bd3f-cf9f6bf7ac4514220950526129827488.avro 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$flushAll$2):106 - Flushing buffer of stream konnektivecrm_5_order (111 MB) 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):115 - Flushing buffer for stream konnektivecrm_5_order (111 MB) to staging 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 - Finished writing data to 34e2e8f5-8f4b-444e-b875-afee807c2fc512304041041026327841.avro (111 MB) 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):108 - Uploading records to staging for stream konnektivecrm_5_order (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 - Initiated multipart upload to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with full ID ABPnzm4n9WXyk_HIp-js39L4-xYgiLoPzrLcTy6tbAAjJL85VWnJNn6aLjG3uHgjiFUNu-g 2022-09-19 13:55:11 destination > 2022-09-19 13:55:11 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 1 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.MultiPartOutputStream(close):158 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 2 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 3 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 4 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 6 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 5 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 7 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 9 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 10 containing 10.01 MB] 2022-09-19 13:55:12 destination > 2022-09-19 13:55:12 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 11 containing 11.91 MB] 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO a.m.s.StreamTransferManager(uploadStreamPart):558 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Finished uploading [Part number 8 containing 10.01 MB] 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO a.m.s.StreamTransferManager(complete):395 - [Manager uploading to adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro with id ABPnzm4n9...gjiFUNu-g]: Completed 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):178 - Uploaded buffer file to storage: 34e2e8f5-8f4b-444e-b875-afee807c2fc512304041041026327841.avro -> data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro (filename: 4.avro) 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):53 - Added staged file: 4.avro 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.r.FileBuffer(deleteFile):81 - Deleting tempFile data 34e2e8f5-8f4b-444e-b875-afee807c2fc512304041041026327841.avro 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.r.SerializedBufferingStrategy(close):127 - Closing buffer for stream konnektivecrm_5_transactions 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.r.SerializedBufferingStrategy(close):127 - Closing buffer for stream konnektivecrm_5_customers 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.r.SerializedBufferingStrategy(close):127 - Closing buffer for stream konnektivecrm_5_order 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):137 - Copying into tables in destination started for 3 streams 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}} (dataset airbyte): [1.avro] 2022-09-19 13:55:14 destination > 2022-09-19 13:55:14 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro 2022-09-19 13:55:15 destination > 2022-09-19 13:55:15 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=f04e6df2-e5c6-4a6f-83d9-03522f0b4f05, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=f04e6df2-e5c6-4a6f-83d9-03522f0b4f05, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595715145, endTime=null, startTime=1663595715296, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=33etFHaDDeC7pG50Rjt1fg==, generatedId=airbyte-354009:US.f04e6df2-e5c6-4a6f-83d9-03522f0b4f05, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/f04e6df2-e5c6-4a6f-83d9-03522f0b4f05?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:55:15 destination > 2022-09-19 13:55:15 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=f04e6df2-e5c6-4a6f-83d9-03522f0b4f05, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595715145, endTime=null, startTime=1663595715296, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=33etFHaDDeC7pG50Rjt1fg==, generatedId=airbyte-354009:US.f04e6df2-e5c6-4a6f-83d9-03522f0b4f05, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/f04e6df2-e5c6-4a6f-83d9-03522f0b4f05?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:19 destination > 2022-09-19 13:55:19 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=f04e6df2-e5c6-4a6f-83d9-03522f0b4f05, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595715145, endTime=null, startTime=1663595715296, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=33etFHaDDeC7pG50Rjt1fg==, generatedId=airbyte-354009:US.f04e6df2-e5c6-4a6f-83d9-03522f0b4f05, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/f04e6df2-e5c6-4a6f-83d9-03522f0b4f05?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:19 destination > 2022-09-19 13:55:19 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=f04e6df2-e5c6-4a6f-83d9-03522f0b4f05, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:55:19 destination > 2022-09-19 13:55:19 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_transactions}} (dataset airbyte, sync mode append_dedup) 2022-09-19 13:55:24 destination > 2022-09-19 13:55:24 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_transactions}} 2022-09-19 13:55:24 destination > 2022-09-19 13:55:24 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte): [1.avro, 2.avro, 3.avro, 4.avro] 2022-09-19 13:55:24 destination > 2022-09-19 13:55:24 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro 2022-09-19 13:55:24 destination > 2022-09-19 13:55:24 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro 2022-09-19 13:55:24 destination > 2022-09-19 13:55:24 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=412174c0-4f5a-4012-a31d-5200a5adcab1, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=412174c0-4f5a-4012-a31d-5200a5adcab1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595724671, endTime=null, startTime=1663595724808, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=UN28yBefXfPfWp+1uiaaDg==, generatedId=airbyte-354009:US.412174c0-4f5a-4012-a31d-5200a5adcab1, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/412174c0-4f5a-4012-a31d-5200a5adcab1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:55:24 destination > 2022-09-19 13:55:24 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=412174c0-4f5a-4012-a31d-5200a5adcab1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595724671, endTime=null, startTime=1663595724808, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=UN28yBefXfPfWp+1uiaaDg==, generatedId=airbyte-354009:US.412174c0-4f5a-4012-a31d-5200a5adcab1, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/412174c0-4f5a-4012-a31d-5200a5adcab1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:24 destination > 2022-09-19 13:55:24 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=49de447e-3b63-4177-927f-23f3c7ffe96c, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=49de447e-3b63-4177-927f-23f3c7ffe96c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595724673, endTime=null, startTime=1663595724812, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=WH1wQUvuuIBmB2rANVigcA==, generatedId=airbyte-354009:US.49de447e-3b63-4177-927f-23f3c7ffe96c, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/49de447e-3b63-4177-927f-23f3c7ffe96c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:55:24 destination > 2022-09-19 13:55:24 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=49de447e-3b63-4177-927f-23f3c7ffe96c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595724673, endTime=null, startTime=1663595724812, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=WH1wQUvuuIBmB2rANVigcA==, generatedId=airbyte-354009:US.49de447e-3b63-4177-927f-23f3c7ffe96c, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/49de447e-3b63-4177-927f-23f3c7ffe96c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:34 destination > 2022-09-19 13:55:34 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=49de447e-3b63-4177-927f-23f3c7ffe96c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595724673, endTime=null, startTime=1663595724812, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=WH1wQUvuuIBmB2rANVigcA==, generatedId=airbyte-354009:US.49de447e-3b63-4177-927f-23f3c7ffe96c, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/49de447e-3b63-4177-927f-23f3c7ffe96c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:34 destination > 2022-09-19 13:55:34 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=49de447e-3b63-4177-927f-23f3c7ffe96c, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:55:34 destination > 2022-09-19 13:55:34 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro 2022-09-19 13:55:34 destination > 2022-09-19 13:55:34 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=ecdd2746-2074-4e40-8ef3-962bfd032f3c, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=ecdd2746-2074-4e40-8ef3-962bfd032f3c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595734458, endTime=null, startTime=1663595734594, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=CvWVtTv+U0mKAjToS8UC8A==, generatedId=airbyte-354009:US.ecdd2746-2074-4e40-8ef3-962bfd032f3c, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/ecdd2746-2074-4e40-8ef3-962bfd032f3c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:55:34 destination > 2022-09-19 13:55:34 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=ecdd2746-2074-4e40-8ef3-962bfd032f3c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595734458, endTime=null, startTime=1663595734594, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=CvWVtTv+U0mKAjToS8UC8A==, generatedId=airbyte-354009:US.ecdd2746-2074-4e40-8ef3-962bfd032f3c, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/ecdd2746-2074-4e40-8ef3-962bfd032f3c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:36 destination > 2022-09-19 13:55:36 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=412174c0-4f5a-4012-a31d-5200a5adcab1, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595724671, endTime=null, startTime=1663595724808, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=UN28yBefXfPfWp+1uiaaDg==, generatedId=airbyte-354009:US.412174c0-4f5a-4012-a31d-5200a5adcab1, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/412174c0-4f5a-4012-a31d-5200a5adcab1?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:36 destination > 2022-09-19 13:55:36 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=412174c0-4f5a-4012-a31d-5200a5adcab1, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:55:36 destination > 2022-09-19 13:55:36 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro 2022-09-19 13:55:36 destination > 2022-09-19 13:55:36 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=a7aa77ff-2978-4033-a8c1-9aa015545e58, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=a7aa77ff-2978-4033-a8c1-9aa015545e58, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595736131, endTime=null, startTime=1663595736279, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=5g0OmSdp0dJgnGZWhi46RQ==, generatedId=airbyte-354009:US.a7aa77ff-2978-4033-a8c1-9aa015545e58, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/a7aa77ff-2978-4033-a8c1-9aa015545e58?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:55:36 destination > 2022-09-19 13:55:36 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=a7aa77ff-2978-4033-a8c1-9aa015545e58, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595736131, endTime=null, startTime=1663595736279, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=5g0OmSdp0dJgnGZWhi46RQ==, generatedId=airbyte-354009:US.a7aa77ff-2978-4033-a8c1-9aa015545e58, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/a7aa77ff-2978-4033-a8c1-9aa015545e58?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:42 destination > 2022-09-19 13:55:42 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=a7aa77ff-2978-4033-a8c1-9aa015545e58, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595736131, endTime=null, startTime=1663595736279, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=5g0OmSdp0dJgnGZWhi46RQ==, generatedId=airbyte-354009:US.a7aa77ff-2978-4033-a8c1-9aa015545e58, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/a7aa77ff-2978-4033-a8c1-9aa015545e58?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:42 destination > 2022-09-19 13:55:42 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=a7aa77ff-2978-4033-a8c1-9aa015545e58, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:55:45 destination > 2022-09-19 13:55:45 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=ecdd2746-2074-4e40-8ef3-962bfd032f3c, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595734458, endTime=null, startTime=1663595734594, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=CvWVtTv+U0mKAjToS8UC8A==, generatedId=airbyte-354009:US.ecdd2746-2074-4e40-8ef3-962bfd032f3c, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/ecdd2746-2074-4e40-8ef3-962bfd032f3c?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:45 destination > 2022-09-19 13:55:45 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=ecdd2746-2074-4e40-8ef3-962bfd032f3c, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:55:45 destination > 2022-09-19 13:55:45 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_customers}} (dataset airbyte, sync mode append_dedup) 2022-09-19 13:55:51 destination > 2022-09-19 13:55:51 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_customers}} 2022-09-19 13:55:51 destination > 2022-09-19 13:55:51 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTmpTableFromStage):122 - Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte): [1.avro, 2.avro, 3.avro, 4.avro] 2022-09-19 13:55:51 destination > 2022-09-19 13:55:51 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro 2022-09-19 13:55:51 destination > 2022-09-19 13:55:51 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro 2022-09-19 13:55:51 destination > 2022-09-19 13:55:51 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=cc48a038-ff45-429f-9934-72f72db69d57, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=cc48a038-ff45-429f-9934-72f72db69d57, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595751423, endTime=null, startTime=1663595751556, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=MEPY6Pz0JnRwuBBl+fZCbA==, generatedId=airbyte-354009:US.cc48a038-ff45-429f-9934-72f72db69d57, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/cc48a038-ff45-429f-9934-72f72db69d57?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:55:51 destination > 2022-09-19 13:55:51 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=cc48a038-ff45-429f-9934-72f72db69d57, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595751423, endTime=null, startTime=1663595751556, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=MEPY6Pz0JnRwuBBl+fZCbA==, generatedId=airbyte-354009:US.cc48a038-ff45-429f-9934-72f72db69d57, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/cc48a038-ff45-429f-9934-72f72db69d57?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:55:51 destination > 2022-09-19 13:55:51 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=27b1572f-1111-4eca-8bbe-1dc7b59864ce, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=27b1572f-1111-4eca-8bbe-1dc7b59864ce, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595751434, endTime=null, startTime=1663595751573, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=Nn7GR/O0HXdKDz6aJ7xWjw==, generatedId=airbyte-354009:US.27b1572f-1111-4eca-8bbe-1dc7b59864ce, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/27b1572f-1111-4eca-8bbe-1dc7b59864ce?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:55:51 destination > 2022-09-19 13:55:51 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=27b1572f-1111-4eca-8bbe-1dc7b59864ce, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595751434, endTime=null, startTime=1663595751573, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=Nn7GR/O0HXdKDz6aJ7xWjw==, generatedId=airbyte-354009:US.27b1572f-1111-4eca-8bbe-1dc7b59864ce, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/27b1572f-1111-4eca-8bbe-1dc7b59864ce?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=cc48a038-ff45-429f-9934-72f72db69d57, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595751423, endTime=null, startTime=1663595751556, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=MEPY6Pz0JnRwuBBl+fZCbA==, generatedId=airbyte-354009:US.cc48a038-ff45-429f-9934-72f72db69d57, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/cc48a038-ff45-429f-9934-72f72db69d57?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=cc48a038-ff45-429f-9934-72f72db69d57, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=27b1572f-1111-4eca-8bbe-1dc7b59864ce, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595751434, endTime=null, startTime=1663595751573, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=Nn7GR/O0HXdKDz6aJ7xWjw==, generatedId=airbyte-354009:US.27b1572f-1111-4eca-8bbe-1dc7b59864ce, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/27b1572f-1111-4eca-8bbe-1dc7b59864ce?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=27b1572f-1111-4eca-8bbe-1dc7b59864ce, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):126 - Uploading staged file: gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=2af6e2d9-3138-4354-86c1-a8bd296b2093, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=2af6e2d9-3138-4354-86c1-a8bd296b2093, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595762401, endTime=null, startTime=1663595762550, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=eeAVoOw6Mt38JUmhY9RMGA==, generatedId=airbyte-354009:US.2af6e2d9-3138-4354-86c1-a8bd296b2093, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/2af6e2d9-3138-4354-86c1-a8bd296b2093?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=2af6e2d9-3138-4354-86c1-a8bd296b2093, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595762401, endTime=null, startTime=1663595762550, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=eeAVoOw6Mt38JUmhY9RMGA==, generatedId=airbyte-354009:US.2af6e2d9-3138-4354-86c1-a8bd296b2093, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/2af6e2d9-3138-4354-86c1-a8bd296b2093?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):135 - [JobId{project=airbyte-354009, job=e2f5e117-3574-450a-bc7c-fcdce9dd385a, location=US}] Created a new job to upload records to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte): Job{job=JobId{project=airbyte-354009, job=e2f5e117-3574-450a-bc7c-fcdce9dd385a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595762510, endTime=null, startTime=1663595762630, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=WEi+nZBYa8D12dzrWLzvew==, generatedId=airbyte-354009:US.e2f5e117-3574-450a-bc7c-fcdce9dd385a, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/e2f5e117-3574-450a-bc7c-fcdce9dd385a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} 2022-09-19 13:56:02 destination > 2022-09-19 13:56:02 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=airbyte-354009, job=e2f5e117-3574-450a-bc7c-fcdce9dd385a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595762510, endTime=null, startTime=1663595762630, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=WEi+nZBYa8D12dzrWLzvew==, generatedId=airbyte-354009:US.e2f5e117-3574-450a-bc7c-fcdce9dd385a, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/e2f5e117-3574-450a-bc7c-fcdce9dd385a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:56:11 destination > 2022-09-19 13:56:11 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=e2f5e117-3574-450a-bc7c-fcdce9dd385a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595762510, endTime=null, startTime=1663595762630, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=WEi+nZBYa8D12dzrWLzvew==, generatedId=airbyte-354009:US.e2f5e117-3574-450a-bc7c-fcdce9dd385a, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/e2f5e117-3574-450a-bc7c-fcdce9dd385a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:56:11 destination > 2022-09-19 13:56:11 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=e2f5e117-3574-450a-bc7c-fcdce9dd385a, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:56:13 destination > 2022-09-19 13:56:13 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=airbyte-354009, job=2af6e2d9-3138-4354-86c1-a8bd296b2093, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1663595762401, endTime=null, startTime=1663595762550, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-connector@airbyte-354009.iam.gserviceaccount.com, etag=eeAVoOw6Mt38JUmhY9RMGA==, generatedId=airbyte-354009:US.2af6e2d9-3138-4354-86c1-a8bd296b2093, selfLink=https://www.googleapis.com/bigquery/v2/projects/airbyte-354009/jobs/2af6e2d9-3138-4354-86c1-a8bd296b2093?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, projectId=airbyte-354009, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://adtractive_airbyte_sync/data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-09-19 13:56:13 destination > 2022-09-19 13:56:13 INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTmpTableFromStage$0):139 - [JobId{project=airbyte-354009, job=2af6e2d9-3138-4354-86c1-a8bd296b2093, location=US}] Tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte) is successfully appended with staging files 2022-09-19 13:56:13 destination > 2022-09-19 13:56:13 INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTargetTable):162 - Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_order}} (dataset airbyte, sync mode append_dedup) 2022-09-19 13:56:17 destination > 2022-09-19 13:56:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_raw_konnektivecrm_5_order}} 2022-09-19 13:56:17 destination > 2022-09-19 13:56:17 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):156 - Finalizing tables in destination completed 2022-09-19 13:56:17 destination > 2022-09-19 13:56:17 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):159 - Cleaning up destination started for 3 streams 2022-09-19 13:56:17 destination > 2022-09-19 13:56:17 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_jbz_konnektivecrm_5_transactions}} (dataset airbyte) 2022-09-19 13:56:17 destination > 2022-09-19 13:56:17 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream konnektivecrm_5_transactions (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_transactions 2022-09-19 13:56:18 destination > 2022-09-19 13:56:18 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 13:56:18 destination > 2022-09-19 13:56:18 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_transactions/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro 2022-09-19 13:56:18 destination > 2022-09-19 13:56:18 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket data_syncs/airbyte_konnektivecrm_5_transactions has been cleaned-up (2 objects were deleted)... 2022-09-19 13:56:18 destination > 2022-09-19 13:56:18 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_idq_konnektivecrm_5_customers}} (dataset airbyte) 2022-09-19 13:56:18 destination > 2022-09-19 13:56:18 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream konnektivecrm_5_customers (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_customers 2022-09-19 13:56:18 destination > 2022-09-19 13:56:18 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 13:56:18 destination > 2022-09-19 13:56:18 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro 2022-09-19 13:56:19 destination > 2022-09-19 13:56:19 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro 2022-09-19 13:56:19 destination > 2022-09-19 13:56:19 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro 2022-09-19 13:56:19 destination > 2022-09-19 13:56:19 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_customers/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro 2022-09-19 13:56:19 destination > 2022-09-19 13:56:19 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket data_syncs/airbyte_konnektivecrm_5_customers has been cleaned-up (5 objects were deleted)... 2022-09-19 13:56:19 destination > 2022-09-19 13:56:19 INFO i.a.i.d.b.BigQueryGcsOperations(dropTableIfExists):172 - Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=airbyte, tableId=_airbyte_tmp_zpd_konnektivecrm_5_order}} (dataset airbyte) 2022-09-19 13:56:19 destination > 2022-09-19 13:56:19 INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):183 - Cleaning up staging path for stream konnektivecrm_5_order (dataset airbyte): data_syncs/airbyte_konnektivecrm_5_order 2022-09-19 13:56:19 destination > 2022-09-19 13:56:19 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/ 2022-09-19 13:56:20 destination > 2022-09-19 13:56:20 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/1.avro 2022-09-19 13:56:20 destination > 2022-09-19 13:56:20 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/2.avro 2022-09-19 13:56:20 destination > 2022-09-19 13:56:20 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/3.avro 2022-09-19 13:56:20 destination > 2022-09-19 13:56:20 INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 - Deleting object data_syncs/airbyte_konnektivecrm_5_order/2022/09/18/23/1b6ee5df-d86b-4bd3-9939-c292f0a7449f/4.avro 2022-09-19 13:56:20 destination > 2022-09-19 13:56:20 INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):270 - Storage bucket data_syncs/airbyte_konnektivecrm_5_order has been cleaned-up (5 objects were deleted)... 2022-09-19 13:56:20 destination > 2022-09-19 13:56:20 INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):164 - Cleaning up destination completed. 2022-09-19 13:56:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):445 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@79dc2e8f[type=STATE,log=,spec=,connectionStatus=,catalog=,record=,state=io.airbyte.protocol.models.AirbyteStateMessage@771bdfc4[type=STREAM,stream=io.airbyte.protocol.models.AirbyteStreamState@732445ff[streamDescriptor=io.airbyte.protocol.models.StreamDescriptor@3626d5ff[name=transactions,namespace=,additionalProperties={}],streamState={"dateCreated":"2022-09-18 23:59:54"},additionalProperties={}],global=,data={"transactions":{"dateCreated":"2022-09-18 23:59:54"},"customers":{"dateCreated":"2022-09-18 21:18:48"},"order":{"dateCreated":"2022-09-18 23:59:00"}},additionalProperties={}],trace=,additionalProperties={}] 2022-09-19 13:56:21 destination > 2022-09-19 13:56:20 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-09-19 13:56:21 INFO i.a.w.g.DefaultReplicationWorker(run):184 - Source and destination threads complete. 2022-09-19 13:56:21 INFO i.a.w.g.DefaultReplicationWorker(run):279 - Source output at least one state message 2022-09-19 13:56:21 INFO i.a.w.g.DefaultReplicationWorker(run):285 - State capture: Updated state to: Optional[io.airbyte.config.State@21a07412[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"transactions"},"stream_state":{"dateCreated":"2022-09-18 23:59:54"}},"data":{"transactions":{"dateCreated":"2022-09-18 23:59:54"},"customers":{"dateCreated":"2022-09-18 21:18:48"},"order":{"dateCreated":"2022-09-18 23:59:00"}}}]]] 2022-09-19 13:56:21 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "completed", "recordsSynced" : 504534, "bytesSynced" : 1417292632, "startTime" : 1663542008580, "endTime" : 1663595781490, "totalStats" : { "recordsEmitted" : 504534, "bytesEmitted" : 1417292632, "sourceStateMessagesEmitted" : 100909, "destinationStateMessagesEmitted" : 1, "recordsCommitted" : 504534, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 40, "maxSecondsBetweenStateMessageEmittedandCommitted" : 89, "meanSecondsBetweenStateMessageEmittedandCommitted" : 89 }, "streamStats" : [ { "streamName" : "konnektivecrm_5_customers", "stats" : { "recordsEmitted" : 215920, "bytesEmitted" : 678849065, "recordsCommitted" : 215920 } }, { "streamName" : "konnektivecrm_5_order", "stats" : { "recordsEmitted" : 286000, "bytesEmitted" : 733507352, "recordsCommitted" : 286000 } }, { "streamName" : "konnektivecrm_5_transactions", "stats" : { "recordsEmitted" : 2614, "bytesEmitted" : 4936215, "recordsCommitted" : 2614 } } ] } 2022-09-19 13:56:21 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ ] 2022-09-19 13:56:21 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-09-19 13:56:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-19 13:56:21 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-09-19 13:56:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-19 13:56:21 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):166 - sync summary: io.airbyte.config.StandardSyncOutput@3c32f86d[standardSyncSummary=io.airbyte.config.StandardSyncSummary@29b94479[status=completed,recordsSynced=504534,bytesSynced=1417292632,startTime=1663542008580,endTime=1663595781490,totalStats=io.airbyte.config.SyncStats@6ecf2f86[recordsEmitted=504534,bytesEmitted=1417292632,sourceStateMessagesEmitted=100909,destinationStateMessagesEmitted=1,recordsCommitted=504534,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=40,maxSecondsBetweenStateMessageEmittedandCommitted=89,meanSecondsBetweenStateMessageEmittedandCommitted=89,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@454a0b04[streamName=konnektivecrm_5_customers,stats=io.airbyte.config.SyncStats@6e107250[recordsEmitted=215920,bytesEmitted=678849065,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=215920,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@de96967[streamName=konnektivecrm_5_order,stats=io.airbyte.config.SyncStats@1acdc443[recordsEmitted=286000,bytesEmitted=733507352,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=286000,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]], io.airbyte.config.StreamSyncStats@f4aee35[streamName=konnektivecrm_5_transactions,stats=io.airbyte.config.SyncStats@62259f7e[recordsEmitted=2614,bytesEmitted=4936215,sourceStateMessagesEmitted=,destinationStateMessagesEmitted=,recordsCommitted=2614,meanSecondsBeforeSourceStateMessageEmitted=,maxSecondsBeforeSourceStateMessageEmitted=,maxSecondsBetweenStateMessageEmittedandCommitted=,meanSecondsBetweenStateMessageEmittedandCommitted=,additionalProperties={}]]]],normalizationSummary=,state=io.airbyte.config.State@21a07412[state=[{"type":"STREAM","stream":{"stream_descriptor":{"name":"transactions"},"stream_state":{"dateCreated":"2022-09-18 23:59:54"}},"data":{"transactions":{"dateCreated":"2022-09-18 23:59:54"},"customers":{"dateCreated":"2022-09-18 21:18:48"},"order":{"dateCreated":"2022-09-18 23:59:00"}}}]],outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@24c1700c[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@50da570b[stream=io.airbyte.protocol.models.AirbyteStream@8b92063[name=konnektivecrm_5_customers,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"dob":{"type":["null","string"]},"city":{"type":["null","string"]},"notes":{"type":["null","object"]},"state":{"type":["null","string"]},"gender":{"type":["null","string"]},"country":{"type":["null","string"]},"custom1":{"type":["null","string"]},"custom2":{"type":["null","string"]},"custom3":{"type":["null","string"]},"custom4":{"type":["null","string"]},"custom5":{"type":["null","string"]},"address1":{"type":["null","string"]},"address2":{"type":["null","string"]},"cardType":{"type":["null","string"]},"lastName":{"type":["null","string"]},"shipCity":{"type":["null","string"]},"sourceID":{"type":["null","string"]},"cardLast4":{"type":["null","string"]},"firstName":{"type":["null","string"]},"ipAddress":{"type":["null","string"]},"paySource":{"type":["null","string"]},"shipState":{"type":["null","string"]},"customerId":{"type":["null","string"]},"paySources":{"type":["null","object"]},"postalCode":{"type":["null","string"]},"sourceType":{"type":["null","string"]},"companyName":{"type":["null","string"]},"dateCreated":{"type":["null","string"]},"dateUpdated":{"type":["null","string"]},"paySourceId":{"type":["null","string"]},"phoneNumber":{"type":["null","string"]},"shipCountry":{"type":["null","string"]},"sourceTitle":{"type":["null","string"]},"billShipSame":{"type":["null","string"]},"campaignName":{"type":["null","string"]},"campaignType":{"type":["null","string"]},"contactOptIn":{"type":["null","string"]},"creditAmount":{"type":["null","string"]},"customFields":{"type":["null","object"]},"emailAddress":{"type":["null","string"]},"shipAddress1":{"type":["null","string"]},"shipAddress2":{"type":["null","string"]},"shipLastName":{"type":["null","string"]},"sourceValue1":{"type":["null","string"]},"sourceValue2":{"type":["null","string"]},"sourceValue3":{"type":["null","string"]},"sourceValue4":{"type":["null","string"]},"sourceValue5":{"type":["null","string"]},"doNotSellName":{"type":["null","string"]},"shipFirstName":{"type":["null","string"]},"cardExpiryDate":{"type":["null","string"]},"clientSourceId":{"type":["null","string"]},"eCommerceLogin":{"type":["null","string"]},"shipPostalCode":{"type":["null","string"]},"shipCompanyName":{"type":["null","string"]},"eCommercePassword":{"type":["null","string"]},"mostRecentActivity":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[dateCreated],sourceDefinedPrimaryKey=[[customerId]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[dateCreated],destinationSyncMode=append_dedup,primaryKey=[[customerId]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@46a99065[stream=io.airbyte.protocol.models.AirbyteStream@6947d9ac[name=konnektivecrm_5_order,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"city":{"type":["null","string"]},"name":{"type":["null","string"]},"affId":{"type":["null","string"]},"items":{"type":["null","object"]},"price":{"type":["null","string"]},"state":{"type":["null","string"]},"UTMTerm":{"type":["null","string"]},"country":{"type":["null","string"]},"custom1":{"type":["null","string"]},"custom2":{"type":["null","string"]},"custom3":{"type":["null","string"]},"custom4":{"type":["null","string"]},"custom5":{"type":["null","string"]},"orderId":{"type":["null","string"]},"address1":{"type":["null","string"]},"address2":{"type":["null","string"]},"cardType":{"type":["null","string"]},"lastName":{"type":["null","string"]},"salesTax":{"type":["null","string"]},"shipCity":{"type":["null","string"]},"sourceId":{"type":["null","string"]},"UTMMedium":{"type":["null","string"]},"UTMSource":{"type":["null","string"]},"agentName":{"type":["null","string"]},"cardLast4":{"type":["null","string"]},"firstName":{"type":["null","string"]},"hasUpsell":{"type":["null","string"]},"ipAddress":{"type":["null","string"]},"orderType":{"type":["null","string"]},"paySource":{"type":["null","string"]},"shipState":{"type":["null","string"]},"surcharge":{"type":["null","string"]},"UTMContent":{"type":["null","string"]},"campaignId":{"type":["null","string"]},"couponCode":{"type":["null","string"]},"customerId":{"type":["null","string"]},"postalCode":{"type":["null","string"]},"shipMethod":{"type":["null","string"]},"UTMCampaign":{"type":["null","string"]},"agentUserId":{"type":["null","string"]},"avsResponse":{"type":["null","string"]},"cardIsDebit":{"type":["null","string"]},"companyName":{"type":["null","string"]},"cvvResponse":{"type":["null","string"]},"dateCreated":{"type":["null","string"]},"dateUpdated":{"type":["null","string"]},"orderStatus":{"type":["null","string"]},"phoneNumber":{"type":["null","string"]},"shipCarrier":{"type":["null","string"]},"shipCountry":{"type":["null","string"]},"sourceTitle":{"type":["null","string"]},"totalAmount":{"type":["null","string"]},"baseShipping":{"type":["null","string"]},"campaignName":{"type":["null","string"]},"currencyCode":{"type":["null","string"]},"emailAddress":{"type":["null","string"]},"fulfillments":{"type":["null","object"]},"reviewStatus":{"type":["null","string"]},"shipAddress1":{"type":["null","string"]},"shipAddress2":{"type":["null","string"]},"shipLastName":{"type":["null","string"]},"shipUpcharge":{"type":["null","string"]},"sourceValue1":{"type":["null","string"]},"sourceValue2":{"type":["null","string"]},"sourceValue3":{"type":["null","string"]},"sourceValue4":{"type":["null","string"]},"sourceValue5":{"type":["null","string"]},"cardIsPrepaid":{"type":["null","string"]},"clientOrderId":{"type":["null","string"]},"discountPrice":{"type":["null","string"]},"isDeclineSave":{"type":["null","string"]},"shipFirstName":{"type":["null","string"]},"shipProfileId":{"type":["null","string"]},"totalDiscount":{"type":["null","string"]},"cardExpiryDate":{"type":["null","string"]},"currencySymbol":{"type":["null","string"]},"shipPostalCode":{"type":["null","string"]},"voiceLogNumber":{"type":["null","string"]},"refundRemaining":{"type":["null","string"]},"shipCompanyName":{"type":["null","string"]},"achAccountNumber":{"type":["null","string"]},"achRoutingNumber":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[dateCreated],sourceDefinedPrimaryKey=[[orderId]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[dateCreated],destinationSyncMode=append_dedup,primaryKey=[[orderId]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@6ba7b980[stream=io.airbyte.protocol.models.AirbyteStream@2adc26af[name=konnektivecrm_5_transactions,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"city":{"type":["null","string"]},"items":{"type":["null","object"]},"state":{"type":["null","string"]},"cardBin":{"type":["null","string"]},"country":{"type":["null","string"]},"custom1":{"type":["null","string"]},"custom2":{"type":["null","string"]},"custom3":{"type":["null","string"]},"custom4":{"type":["null","string"]},"custom5":{"type":["null","string"]},"orderId":{"type":["null","string"]},"txnType":{"type":["null","string"]},"address1":{"type":["null","string"]},"address2":{"type":["null","string"]},"authCode":{"type":["null","string"]},"cardType":{"type":["null","string"]},"lastName":{"type":["null","string"]},"merchant":{"type":["null","string"]},"cardLast4":{"type":["null","string"]},"firstName":{"type":["null","string"]},"midNumber":{"type":["null","string"]},"orderType":{"type":["null","string"]},"paySource":{"type":["null","string"]},"surcharge":{"type":["null","string"]},"campaignId":{"type":["null","string"]},"customerId":{"type":["null","string"]},"merchantId":{"type":["null","string"]},"postalCode":{"type":["null","string"]},"3DTxnResult":{"type":["null","string"]},"achBankName":{"type":["null","string"]},"avsResponse":{"type":["null","string"]},"cardIsDebit":{"type":["null","string"]},"clientTxnId":{"type":["null","string"]},"cvvResponse":{"type":["null","string"]},"dateCreated":{"type":["null","string"]},"dateUpdated":{"type":["null","string"]},"parentTxnId":{"type":["null","string"]},"paySourceId":{"type":["null","string"]},"phoneNumber":{"type":["null","string"]},"sourceTitle":{"type":["null","string"]},"totalAmount":{"type":["null","string"]},"campaignName":{"type":["null","string"]},"emailAddress":{"type":["null","string"]},"refundReason":{"type":["null","string"]},"responseText":{"type":["null","string"]},"responseType":{"type":["null","string"]},"sourceValue1":{"type":["null","string"]},"sourceValue2":{"type":["null","string"]},"sourceValue3":{"type":["null","string"]},"sourceValue4":{"type":["null","string"]},"sourceValue5":{"type":["null","string"]},"cardIsPrepaid":{"type":["null","string"]},"clientOrderId":{"type":["null","string"]},"isChargedback":{"type":["null","string"]},"merchantTxnId":{"type":["null","string"]},"recycleNumber":{"type":["null","string"]},"transactionId":{"type":["null","string"]},"chargebackDate":{"type":["null","string"]},"chargebackNote":{"type":["null","string"]},"currencySymbol":{"type":["null","string"]},"orderAgentName":{"type":["null","string"]},"achAccountNumber":{"type":["null","string"]},"achRoutingNumber":{"type":["null","string"]},"chargebackAmount":{"type":["null","string"]},"billingCycleNumber":{"type":["null","string"]},"merchantDescriptor":{"type":["null","string"]},"campaignCategoryName":{"type":["null","string"]},"chargebackReasonCode":{"type":["null","string"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[dateCreated],sourceDefinedPrimaryKey=[[transactionId]],namespace=,additionalProperties={}],syncMode=incremental,cursorField=[dateCreated],destinationSyncMode=append_dedup,primaryKey=[[transactionId]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-09-19 13:56:21 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating... 2022-09-19 13:56:21 INFO i.a.w.t.TemporalAttemptExecution(get):106 - Docker volume job log path: /tmp/workspace/538/0/logs.log 2022-09-19 13:56:21 INFO i.a.w.t.TemporalAttemptExecution(get):111 - Executing worker wrapper. Airbyte version: 0.40.6 2022-09-19 13:56:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-19 13:56:21 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START DEFAULT NORMALIZATION ----- 2022-09-19 13:56:21 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-19 13:56:21 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):138 - Running with normalization version: airbyte/normalization:0.2.21 2022-09-19 13:56:21 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/normalization:0.2.21 exists... 2022-09-19 13:56:21 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/normalization:0.2.21 was found locally. 2022-09-19 13:56:21 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = normalization-normalize-538-0-mqvrz with resources io.airbyte.config.ResourceRequirements@2c1409f4[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-09-19 13:56:21 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/538/0/normalize --log-driver none --name normalization-normalize-538-0-mqvrz --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.40.6 airbyte/normalization:0.2.21 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-09-19 13:56:22 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/538/0/normalize 2022-09-19 13:56:23 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/538/0/normalize') 2022-09-19 13:56:23 normalization > transform_bigquery 2022-09-19 13:56:23 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/538/0/normalize --catalog destination_catalog.json --out /data/538/0/normalize/models/generated/ --json-column _airbyte_data 2022-09-19 13:56:24 normalization > Processing destination_catalog.json... 2022-09-19 13:56:24 normalization > Generating airbyte_ctes/airbyte/konnektivecrm_5_customers_ab1.sql from konnektivecrm_5_customers 2022-09-19 13:56:24 normalization > Generating airbyte_ctes/airbyte/konnektivecrm_5_customers_ab2.sql from konnektivecrm_5_customers 2022-09-19 13:56:24 normalization > Generating airbyte_views/airbyte/konnektivecrm_5_customers_stg.sql from konnektivecrm_5_customers 2022-09-19 13:56:24 normalization > Generating airbyte_incremental/scd/airbyte/konnektivecrm_5_customers_scd.sql from konnektivecrm_5_customers 2022-09-19 13:56:24 normalization > Generating airbyte_incremental/airbyte/konnektivecrm_5_customers.sql from konnektivecrm_5_customers 2022-09-19 13:56:24 normalization > Generating airbyte_ctes/airbyte/konnektivecrm_5_order_ab1.sql from konnektivecrm_5_order 2022-09-19 13:56:24 normalization > Generating airbyte_ctes/airbyte/konnektivecrm_5_order_ab2.sql from konnektivecrm_5_order 2022-09-19 13:56:24 normalization > Generating airbyte_views/airbyte/konnektivecrm_5_order_stg.sql from konnektivecrm_5_order 2022-09-19 13:56:24 normalization > Generating airbyte_incremental/scd/airbyte/konnektivecrm_5_order_scd.sql from konnektivecrm_5_order 2022-09-19 13:56:24 normalization > Generating airbyte_incremental/airbyte/konnektivecrm_5_order.sql from konnektivecrm_5_order 2022-09-19 13:56:24 normalization > Generating airbyte_ctes/airbyte/konnektivecrm_5_transactions_ab1.sql from konnektivecrm_5_transactions 2022-09-19 13:56:24 normalization > Generating airbyte_ctes/airbyte/konnektivecrm_5_transactions_ab2.sql from konnektivecrm_5_transactions 2022-09-19 13:56:24 normalization > Generating airbyte_views/airbyte/konnektivecrm_5_transactions_stg.sql from konnektivecrm_5_transactions 2022-09-19 13:56:24 normalization > Generating airbyte_incremental/scd/airbyte/konnektivecrm_5_transactions_scd.sql from konnektivecrm_5_transactions 2022-09-19 13:56:24 normalization > Generating airbyte_incremental/airbyte/konnektivecrm_5_transactions.sql from konnektivecrm_5_transactions 2022-09-19 13:56:24 normalization > detected no config file for ssh, assuming ssh is off. 2022-09-19 13:56:28 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-09-19 13:56:28 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-09-19 13:56:28 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-09-19 13:56:28 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-09-19 13:56:28 INFO i.a.w.n.NormalizationAirbyteStreamFactory(filterOutAndHandleNonAirbyteMessageLines):104 - 2022-09-19 13:56:33 normalization > Running with dbt=1.0.0 2022-09-19 13:56:33 normalization > Partial parse save file not found. Starting full parse. 2022-09-19 13:56:36 normalization > [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. There are 1 unused configuration paths: - models.airbyte_utils.generated.airbyte_tables 2022-09-19 13:56:36 normalization > Found 15 models, 0 tests, 0 snapshots, 0 analyses, 602 macros, 0 operations, 0 seed files, 3 sources, 0 exposures, 0 metrics 2022-09-19 13:56:38 normalization > Concurrency: 8 threads (target='prod') 2022-09-19 13:56:39 normalization > 1 of 9 START view model _airbyte_airbyte.konnektivecrm_5_customers_stg.................................................. [RUN] 2022-09-19 13:56:39 normalization > 2 of 9 START view model _airbyte_airbyte.konnektivecrm_5_order_stg...................................................... [RUN] 2022-09-19 13:56:39 normalization > 3 of 9 START view model _airbyte_airbyte.konnektivecrm_5_transactions_stg............................................... [RUN] 2022-09-19 13:56:41 normalization > 1 of 9 OK created view model _airbyte_airbyte.konnektivecrm_5_customers_stg............................................. [OK in 1.94s] 2022-09-19 13:56:41 normalization > 4 of 9 START incremental model airbyte.konnektivecrm_5_customers_scd.................................................... [RUN] 2022-09-19 13:56:41 normalization > 3 of 9 OK created view model _airbyte_airbyte.konnektivecrm_5_transactions_stg.......................................... [OK in 1.63s] 2022-09-19 13:56:41 normalization > 2 of 9 OK created view model _airbyte_airbyte.konnektivecrm_5_order_stg................................................. [OK in 1.73s] 2022-09-19 13:56:41 normalization > 5 of 9 START incremental model airbyte.konnektivecrm_5_transactions_scd................................................. [RUN] 2022-09-19 13:56:41 normalization > 6 of 9 START incremental model airbyte.konnektivecrm_5_order_scd........................................................ [RUN] 2022-09-19 13:57:19 normalization > 5 of 9 OK created incremental model airbyte.konnektivecrm_5_transactions_scd............................................ [MERGE (3.9k rows, 255.0 MB processed) in 38.05s] 2022-09-19 13:57:19 normalization > 7 of 9 START incremental model airbyte.konnektivecrm_5_transactions..................................................... [RUN] 2022-09-19 13:57:44 normalization > 7 of 9 OK created incremental model airbyte.konnektivecrm_5_transactions................................................ [MERGE (2.6k rows, 236.6 MB processed) in 24.73s] 2022-09-19 14:00:31 normalization > 4 of 9 OK created incremental model airbyte.konnektivecrm_5_customers_scd............................................... [MERGE (430.9k rows, 1.5 GB processed) in 230.45s] 2022-09-19 14:00:31 normalization > 8 of 9 START incremental model airbyte.konnektivecrm_5_customers........................................................ [RUN] 2022-09-19 14:01:28 normalization > 8 of 9 OK created incremental model airbyte.konnektivecrm_5_customers................................................... [MERGE (215.9k rows, 964.1 MB processed) in 56.14s] 2022-09-19 14:01:47 normalization > 6 of 9 OK created incremental model airbyte.konnektivecrm_5_order_scd................................................... [MERGE (570.8k rows, 1.1 GB processed) in 306.14s] 2022-09-19 14:01:47 normalization > 9 of 9 START incremental model airbyte.konnektivecrm_5_order............................................................ [RUN] 2022-09-19 14:03:02 normalization > 9 of 9 OK created incremental model airbyte.konnektivecrm_5_order....................................................... [MERGE (285.9k rows, 741.7 MB processed) in 74.59s] 2022-09-19 14:03:02 normalization > Finished running 3 view models, 6 incremental models in 385.67s. 2022-09-19 14:03:02 normalization > Completed successfully 2022-09-19 14:03:02 normalization > Done. PASS=9 WARN=0 ERROR=0 SKIP=0 TOTAL=9 2022-09-19 14:03:02 INFO i.a.w.g.DefaultNormalizationWorker(run):82 - Normalization executed in 6 minutes 41 seconds. 2022-09-19 14:03:02 INFO i.a.w.g.DefaultNormalizationWorker(run):95 - Normalization summary: io.airbyte.config.NormalizationSummary@4cb5e421[startTime=1663595781727,endTime=1663596182972,failures=[]] 2022-09-19 14:03:02 INFO i.a.w.t.TemporalAttemptExecution(get):132 - Stopping cancellation check scheduling... 2022-09-19 14:03:02 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):312 - Stopping temporal heartbeating... 2022-09-19 14:03:02 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-09-19 14:03:02 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END DEFAULT NORMALIZATION ----- 2022-09-19 14:03:02 INFO i.a.c.i.LineGobbler(voidCall):114 -