2022-08-19 15:04:53 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/0/logs.log 2022-08-19 15:04:53 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:04:53 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if source-learnworlds-connector:1.1.2 exists... 2022-08-19 15:04:53 INFO i.a.c.i.LineGobbler(voidCall):82 - source-learnworlds-connector:1.1.2 was found locally. 2022-08-19 15:04:53 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:04:53 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/0 --log-driver none --name source-learnworlds-connector-check-45-0-desgd --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=source-learnworlds-connector:1.1.2 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 source-learnworlds-connector:1.1.2 check --config source_config.json 2022-08-19 15:04:55 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-08-19 15:04:55 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:04:56 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/0/logs.log 2022-08-19 15:04:56 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:04:56 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-08-19 15:04:56 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-08-19 15:04:56 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:04:56 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/0 --log-driver none --name destination-bigquery-check-45-0-omdxj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 airbyte/destination-bigquery:1.1.11 check --config source_config.json 2022-08-19 15:04:56 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-08-19 15:04:56 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:04:56 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:04:56 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:04:56 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-19 15:04:56 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-19 15:04:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:04:57 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-08-19 15:04:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:04:57 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:04:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:04:57 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-08-19 15:04:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:04:57 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-08-19 15:04:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:04:57 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:04:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:04:57 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:04:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:04:57 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:04:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:04:57 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:04:59 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:04:59 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/0/logs.log 2022-08-19 15:04:59 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:04:59 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 45 attempt id: 0 2022-08-19 15:04:59 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.bundles=full_refresh - overwrite} 2022-08-19 15:04:59 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-08-19 15:04:59 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-08-19 15:04:59 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-08-19 15:04:59 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:04:59 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/0 --log-driver none --name destination-bigquery-write-45-0-xuesk --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 airbyte/destination-bigquery:1.1.11 write --config destination_config.json --catalog destination_catalog.json 2022-08-19 15:04:59 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if source-learnworlds-connector:1.1.2 exists... 2022-08-19 15:05:00 INFO i.a.c.i.LineGobbler(voidCall):82 - source-learnworlds-connector:1.1.2 was found locally. 2022-08-19 15:05:00 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:05:00 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/0 --log-driver none --name source-learnworlds-connector-read-45-0-aoyqo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=source-learnworlds-connector:1.1.2 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 source-learnworlds-connector:1.1.2 read --config source_config.json --catalog source_catalog.json 2022-08-19 15:05:00 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-08-19 15:05:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - Destination output thread started. 2022-08-19 15:05:00 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-08-19 15:05:00 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-08-19 15:05:00 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:05:00 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:05:00 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:05:00 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-19 15:05:00 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 WARN i.a.i.d.b.BigQueryDestination(getConsumer):197 - The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data. 2022-08-19 15:05:01 source > Starting syncing SourceLearnworldsConnector 2022-08-19 15:05:01 source > Syncing stream: bundles 2022-08-19 15:05:01 destination > 2022-08-19 15:05:01 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:05:02 source > Read 13 records from bundles stream 2022-08-19 15:05:02 source > Finished syncing bundles 2022-08-19 15:05:02 source > SourceLearnworldsConnector runtimes: Syncing stream bundles 0:00:00.613011 2022-08-19 15:05:02 source > Finished syncing SourceLearnworldsConnector 2022-08-19 15:05:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):327 - Source has no more messages, closing connection. 2022-08-19 15:05:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):335 - Total records read: 13 (6 KB) 2022-08-19 15:05:02 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other. 2022-08-19 15:05:03 destination > 2022-08-19 15:05:03 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_tmp_xyu_bundles}} 2022-08-19 15:05:04 destination > 2022-08-19 15:05:04 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-08-19 15:05:04 destination > 2022-08-19 15:05:04 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-08-19 15:05:04 destination > 2022-08-19 15:05:04 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_bundles, tmpTable=_airbyte_tmp_xyu_bundles, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-08-19 15:05:05 destination > 2022-08-19 15:05:05 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=g4-data, job=054c2a86-0441-47bf-85d7-c4ec010ea243, location=us-east1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1660921501908, endTime=null, startTime=1660921502070, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-learnworlds@g4-data.iam.gserviceaccount.com, etag=NzukHmnq8eDA+z/wUtiMBg==, generatedId=g4-data:us-east1.054c2a86-0441-47bf-85d7-c4ec010ea243, selfLink=https://www.googleapis.com/bigquery/v2/projects/g4-data/jobs/054c2a86-0441-47bf-85d7-c4ec010ea243?location=us-east1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, projectId=g4-data, tableId=_airbyte_tmp_xyu_bundles}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-08-19 15:05:08 destination > 2022-08-19 15:05:08 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=g4-data, job=054c2a86-0441-47bf-85d7-c4ec010ea243, location=us-east1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1660921501908, endTime=null, startTime=1660921502070, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-learnworlds@g4-data.iam.gserviceaccount.com, etag=NzukHmnq8eDA+z/wUtiMBg==, generatedId=g4-data:us-east1.054c2a86-0441-47bf-85d7-c4ec010ea243, selfLink=https://www.googleapis.com/bigquery/v2/projects/g4-data/jobs/054c2a86-0441-47bf-85d7-c4ec010ea243?location=us-east1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, projectId=g4-data, tableId=_airbyte_tmp_xyu_bundles}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-08-19 15:05:08 destination > 2022-08-19 15:05:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_xyu_bundles to the source table _airbyte_raw_bundles. 2022-08-19 15:05:08 destination > 2022-08-19 15:05:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-08-19 15:05:11 destination > 2022-08-19 15:05:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_tmp_xyu_bundles}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_raw_bundles}} 2022-08-19 15:05:11 destination > 2022-08-19 15:05:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_bundles! 2022-08-19 15:05:11 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-08-19 15:05:11 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-08-19 15:05:11 destination > 2022-08-19 15:05:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-08-19 15:05:11 destination > 2022-08-19 15:05:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-08-19 15:05:11 destination > 2022-08-19 15:05:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-08-19 15:05:11 destination > 2022-08-19 15:05:11 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_bundles, tmpTable=_airbyte_tmp_xyu_bundles, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-08-19 15:05:11 destination > 2022-08-19 15:05:11 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:05:11 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete. 2022-08-19 15:05:11 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@3d5f1ff8[status=completed,recordsSynced=13,bytesSynced=6407,startTime=1660921499930,endTime=1660921511841,totalStats=io.airbyte.config.SyncStats@6d6123f1[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=0,recordsCommitted=13],streamStats=[io.airbyte.config.StreamSyncStats@62f6738[streamName=bundles,stats=io.airbyte.config.SyncStats@73be823[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=,recordsCommitted=13]]]] 2022-08-19 15:05:11 INFO i.a.w.g.DefaultReplicationWorker(run):268 - Source did not output any state messages 2022-08-19 15:05:11 WARN i.a.w.g.DefaultReplicationWorker(run):279 - State capture: No state retained. 2022-08-19 15:05:11 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:05:11 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@23cc038d[standardSyncSummary=io.airbyte.config.StandardSyncSummary@66ce9990[status=completed,recordsSynced=13,bytesSynced=6407,startTime=1660921499930,endTime=1660921511841,totalStats=io.airbyte.config.SyncStats@6d6123f1[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=0,recordsCommitted=13],streamStats=[io.airbyte.config.StreamSyncStats@62f6738[streamName=bundles,stats=io.airbyte.config.SyncStats@73be823[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=,recordsCommitted=13]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@6c377634[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@5762ded2[stream=io.airbyte.protocol.models.AirbyteStream@14716fd8[name=bundles,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-04/schema#","required":["id","title","products","image","description","access","created","modified","afterPurchase","price","paymentPlans"],"properties":{"id":{"type":"string"},"image":{"type":["string","null"]},"price":{"type":"integer"},"title":{"type":"string"},"access":{"type":"string"},"created":{"type":"number"},"modified":{"type":"number"},"products":{"type":"object","properties":{"courses":{"type":"array","items":[{"type":"string"}]}}},"description":{"type":["string","null"]},"paymentPlans":{"type":"array","items":[{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"type":"string"},"order":{"type":"integer"},"amount":{"type":"integer"},"status":{"type":"string"},"validTo":{"type":["string","null"]},"validFrom":{"type":["string","null"]},"description":{"type":["string","null"]},"firstAmount":{"type":"integer"},"isCancelable":{"type":"boolean"},"nameOverride":{"type":"boolean"},"paymentsCount":{"type":"integer"},"subscriptionTrialDate":{"type":["string","null"]},"subscriptionTrialDays":{"type":["string","null"]},"subscriptionTrialType":{"type":"string"},"paymentPlanNameOverride":{"type":["string","null"]},"subscriptionIntervalType":{"type":"string"}}}]},"afterPurchase":{"type":"object","properties":{"type":{"type":"string"},"settings":{"type":"object","properties":{"url":{"type":["string","null"]},"page":{"type":["string","null"]}}}}}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-08-19 15:05:11 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-19 15:05:11 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/0/logs.log 2022-08-19 15:05:11 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:05:11 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization. 2022-08-19 15:05:11 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.8 2022-08-19 15:05:11 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.8 exists... 2022-08-19 15:05:11 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.8 not found locally. Attempting to pull the image... 2022-08-19 15:05:54 INFO i.a.c.i.LineGobbler(voidCall):82 - Pulled airbyte/normalization:0.2.8 from remote. 2022-08-19 15:05:54 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:05:54 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/0/normalize --log-driver none --name normalization-normalize-45-0-srxde --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.39.37-alpha airbyte/normalization:0.2.8 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-08-19 15:06:10 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/45/0/normalize 2022-08-19 15:06:11 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/45/0/normalize') 2022-08-19 15:06:11 normalization > transform_bigquery 2022-08-19 15:06:11 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/45/0/normalize --catalog destination_catalog.json --out /data/45/0/normalize/models/generated/ --json-column _airbyte_data 2022-08-19 15:06:11 normalization > Processing destination_catalog.json... 2022-08-19 15:06:11 normalization > {"type": "LOG", "log": {"level": "FATAL", "message": "'list' object has no attribute 'get'\nTraceback (most recent call last):\n File \"/usr/local/bin/transform-catalog\", line 8, in \n sys.exit(main())\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 104, in main\n TransformCatalog().run(args)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 36, in run\n self.process_catalog()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 64, in process_catalog\n processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py\", line 76, in process\n nested_processors = stream_processor.process()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 254, in process\n self.generate_json_parsing_model(from_table, column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 417, in generate_json_parsing_model\n fields=self.extract_json_columns(column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 440, in extract_json_columns\n return [\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 441, in \n self.extract_json_column(field, self.json_column_name, self.properties[field], column_names[field][0], \"table_alias\")\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 459, in extract_json_column\n if is_simple_property(definition.get(\"items\", {\"type\": \"object\"}).get(\"type\", \"object\")):\nAttributeError: 'list' object has no attribute 'get'"}} 2022-08-19 15:06:11 normalization > {"type": "TRACE", "trace": {"type": "ERROR", "emitted_at": 1660921571506.795, "error": {"message": "Something went wrong in the connector. See the logs for more details.", "internal_message": "'list' object has no attribute 'get'", "stack_trace": "Traceback (most recent call last):\n File \"/usr/local/bin/transform-catalog\", line 8, in \n sys.exit(main())\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 104, in main\n TransformCatalog().run(args)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 36, in run\n self.process_catalog()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 64, in process_catalog\n processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py\", line 76, in process\n nested_processors = stream_processor.process()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 254, in process\n self.generate_json_parsing_model(from_table, column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 417, in generate_json_parsing_model\n fields=self.extract_json_columns(column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 440, in extract_json_columns\n return [\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 441, in \n self.extract_json_column(field, self.json_column_name, self.properties[field], column_names[field][0], \"table_alias\")\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 459, in extract_json_column\n if is_simple_property(definition.get(\"items\", {\"type\": \"object\"}).get(\"type\", \"object\")):\nAttributeError: 'list' object has no attribute 'get'\n", "failure_type": "system_error"}}} 2022-08-19 15:06:11 normalization > 2022-08-19 15:06:11 normalization > Showing destination_catalog.json to diagnose/debug errors (1): 2022-08-19 15:06:11 normalization > 2022-08-19 15:06:11 normalization > { 2022-08-19 15:06:11 normalization > "streams": [ 2022-08-19 15:06:11 normalization > { 2022-08-19 15:06:11 normalization > "stream": { 2022-08-19 15:06:11 normalization > "name": "bundles", 2022-08-19 15:06:11 normalization > "json_schema": { 2022-08-19 15:06:11 normalization > "type": "object", 2022-08-19 15:06:11 normalization > "$schema": "http://json-schema.org/draft-04/schema#", 2022-08-19 15:06:11 normalization > "required": [ 2022-08-19 15:06:11 normalization > "id", 2022-08-19 15:06:11 normalization > "title", 2022-08-19 15:06:11 normalization > "products", 2022-08-19 15:06:11 normalization > "image", 2022-08-19 15:06:11 normalization > "description", 2022-08-19 15:06:11 normalization > "access", 2022-08-19 15:06:11 normalization > "created", 2022-08-19 15:06:11 normalization > "modified", 2022-08-19 15:06:11 normalization > "afterPurchase", 2022-08-19 15:06:11 normalization > "price", 2022-08-19 15:06:11 normalization > "paymentPlans" 2022-08-19 15:06:11 normalization > ], 2022-08-19 15:06:11 normalization > "properties": { 2022-08-19 15:06:11 normalization > "id": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "image": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "price": { 2022-08-19 15:06:11 normalization > "type": "integer" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "title": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "access": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "created": { 2022-08-19 15:06:11 normalization > "type": "number" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "modified": { 2022-08-19 15:06:11 normalization > "type": "number" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "products": { 2022-08-19 15:06:11 normalization > "type": "object", 2022-08-19 15:06:11 normalization > "properties": { 2022-08-19 15:06:11 normalization > "courses": { 2022-08-19 15:06:11 normalization > "type": "array", 2022-08-19 15:06:11 normalization > "items": [ 2022-08-19 15:06:11 normalization > { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "description": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "paymentPlans": { 2022-08-19 15:06:11 normalization > "type": "array", 2022-08-19 15:06:11 normalization > "items": [ 2022-08-19 15:06:11 normalization > { 2022-08-19 15:06:11 normalization > "type": "object", 2022-08-19 15:06:11 normalization > "properties": { 2022-08-19 15:06:11 normalization > "id": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "name": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "type": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "order": { 2022-08-19 15:06:11 normalization > "type": "integer" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "amount": { 2022-08-19 15:06:11 normalization > "type": "integer" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "status": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "validTo": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "validFrom": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "description": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "firstAmount": { 2022-08-19 15:06:11 normalization > "type": "integer" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "isCancelable": { 2022-08-19 15:06:11 normalization > "type": "boolean" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "nameOverride": { 2022-08-19 15:06:11 normalization > "type": "boolean" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "paymentsCount": { 2022-08-19 15:06:11 normalization > "type": "integer" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "subscriptionTrialDate": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "subscriptionTrialDays": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "subscriptionTrialType": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "paymentPlanNameOverride": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "subscriptionIntervalType": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "afterPurchase": { 2022-08-19 15:06:11 normalization > "type": "object", 2022-08-19 15:06:11 normalization > "properties": { 2022-08-19 15:06:11 normalization > "type": { 2022-08-19 15:06:11 normalization > "type": "string" 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "settings": { 2022-08-19 15:06:11 normalization > "type": "object", 2022-08-19 15:06:11 normalization > "properties": { 2022-08-19 15:06:11 normalization > "url": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "page": { 2022-08-19 15:06:11 normalization > "type": [ 2022-08-19 15:06:11 normalization > "string", 2022-08-19 15:06:11 normalization > "null" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "supported_sync_modes": [ 2022-08-19 15:06:11 normalization > "full_refresh" 2022-08-19 15:06:11 normalization > ], 2022-08-19 15:06:11 normalization > "default_cursor_field": [], 2022-08-19 15:06:11 normalization > "source_defined_primary_key": [ 2022-08-19 15:06:11 normalization > [ 2022-08-19 15:06:11 normalization > "id" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > }, 2022-08-19 15:06:11 normalization > "sync_mode": "full_refresh", 2022-08-19 15:06:11 normalization > "cursor_field": [], 2022-08-19 15:06:11 normalization > "destination_sync_mode": "overwrite", 2022-08-19 15:06:11 normalization > "primary_key": [ 2022-08-19 15:06:11 normalization > [ 2022-08-19 15:06:11 normalization > "id" 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 normalization > ] 2022-08-19 15:06:11 normalization > } 2022-08-19 15:06:11 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-08-19 15:06:11 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:11 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-19 15:06:11 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=5e46ca6a-d8e2-3b19-98c9-efe88186362b, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:289) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-08-19 15:06:12 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/1/logs.log 2022-08-19 15:06:12 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:06:12 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if source-learnworlds-connector:1.1.2 exists... 2022-08-19 15:06:12 INFO i.a.c.i.LineGobbler(voidCall):82 - source-learnworlds-connector:1.1.2 was found locally. 2022-08-19 15:06:12 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:12 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/1 --log-driver none --name source-learnworlds-connector-check-45-1-gzcls --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=source-learnworlds-connector:1.1.2 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 source-learnworlds-connector:1.1.2 check --config source_config.json 2022-08-19 15:06:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-08-19 15:06:15 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:15 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/1/logs.log 2022-08-19 15:06:15 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:06:15 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-08-19 15:06:15 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-08-19 15:06:15 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:15 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/1 --log-driver none --name destination-bigquery-check-45-1-imikp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 airbyte/destination-bigquery:1.1.11 check --config source_config.json 2022-08-19 15:06:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-08-19 15:06:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-19 15:06:16 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-19 15:06:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:17 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-08-19 15:06:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:17 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:06:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:17 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-08-19 15:06:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:17 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-08-19 15:06:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:17 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:17 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:17 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:18 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:18 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:06:20 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:20 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/1/logs.log 2022-08-19 15:06:20 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:06:20 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 45 attempt id: 1 2022-08-19 15:06:20 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.bundles=full_refresh - overwrite} 2022-08-19 15:06:20 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-08-19 15:06:20 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-08-19 15:06:20 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-08-19 15:06:20 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:20 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/1 --log-driver none --name destination-bigquery-write-45-1-scoom --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 airbyte/destination-bigquery:1.1.11 write --config destination_config.json --catalog destination_catalog.json 2022-08-19 15:06:20 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if source-learnworlds-connector:1.1.2 exists... 2022-08-19 15:06:20 INFO i.a.c.i.LineGobbler(voidCall):82 - source-learnworlds-connector:1.1.2 was found locally. 2022-08-19 15:06:20 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:20 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/1 --log-driver none --name source-learnworlds-connector-read-45-1-gzfuw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=source-learnworlds-connector:1.1.2 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 source-learnworlds-connector:1.1.2 read --config source_config.json --catalog source_catalog.json 2022-08-19 15:06:21 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-08-19 15:06:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - Destination output thread started. 2022-08-19 15:06:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-08-19 15:06:21 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-08-19 15:06:21 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:21 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:21 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:21 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-19 15:06:21 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-08-19 15:06:22 source > Starting syncing SourceLearnworldsConnector 2022-08-19 15:06:22 source > Syncing stream: bundles 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 WARN i.a.i.d.b.BigQueryDestination(getConsumer):197 - The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data. 2022-08-19 15:06:22 destination > 2022-08-19 15:06:22 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:06:23 source > Read 13 records from bundles stream 2022-08-19 15:06:23 source > Finished syncing bundles 2022-08-19 15:06:23 source > SourceLearnworldsConnector runtimes: Syncing stream bundles 0:00:00.638320 2022-08-19 15:06:23 source > Finished syncing SourceLearnworldsConnector 2022-08-19 15:06:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):327 - Source has no more messages, closing connection. 2022-08-19 15:06:23 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):335 - Total records read: 13 (6 KB) 2022-08-19 15:06:23 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other. 2022-08-19 15:06:24 destination > 2022-08-19 15:06:24 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_tmp_oer_bundles}} 2022-08-19 15:06:25 destination > 2022-08-19 15:06:25 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-08-19 15:06:25 destination > 2022-08-19 15:06:25 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-08-19 15:06:25 destination > 2022-08-19 15:06:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_bundles, tmpTable=_airbyte_tmp_oer_bundles, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-08-19 15:06:27 destination > 2022-08-19 15:06:27 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=g4-data, job=7a34257c-c433-48b3-8af3-20d522df1784, location=us-east1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1660921583260, endTime=null, startTime=1660921583458, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-learnworlds@g4-data.iam.gserviceaccount.com, etag=OzvlhaJXv/aJ7YYsHOntgw==, generatedId=g4-data:us-east1.7a34257c-c433-48b3-8af3-20d522df1784, selfLink=https://www.googleapis.com/bigquery/v2/projects/g4-data/jobs/7a34257c-c433-48b3-8af3-20d522df1784?location=us-east1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, projectId=g4-data, tableId=_airbyte_tmp_oer_bundles}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-08-19 15:06:30 destination > 2022-08-19 15:06:30 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=g4-data, job=7a34257c-c433-48b3-8af3-20d522df1784, location=us-east1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1660921583260, endTime=null, startTime=1660921583458, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-learnworlds@g4-data.iam.gserviceaccount.com, etag=OzvlhaJXv/aJ7YYsHOntgw==, generatedId=g4-data:us-east1.7a34257c-c433-48b3-8af3-20d522df1784, selfLink=https://www.googleapis.com/bigquery/v2/projects/g4-data/jobs/7a34257c-c433-48b3-8af3-20d522df1784?location=us-east1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, projectId=g4-data, tableId=_airbyte_tmp_oer_bundles}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-08-19 15:06:30 destination > 2022-08-19 15:06:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_oer_bundles to the source table _airbyte_raw_bundles. 2022-08-19 15:06:30 destination > 2022-08-19 15:06:30 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-08-19 15:06:31 destination > 2022-08-19 15:06:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_tmp_oer_bundles}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_raw_bundles}} 2022-08-19 15:06:31 destination > 2022-08-19 15:06:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_bundles! 2022-08-19 15:06:31 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-08-19 15:06:31 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-08-19 15:06:31 destination > 2022-08-19 15:06:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-08-19 15:06:31 destination > 2022-08-19 15:06:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-08-19 15:06:31 destination > 2022-08-19 15:06:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-08-19 15:06:31 destination > 2022-08-19 15:06:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_bundles, tmpTable=_airbyte_tmp_oer_bundles, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-08-19 15:06:31 destination > 2022-08-19 15:06:31 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:06:31 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete. 2022-08-19 15:06:31 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@6a613dbe[status=completed,recordsSynced=13,bytesSynced=6407,startTime=1660921580894,endTime=1660921591910,totalStats=io.airbyte.config.SyncStats@767358e0[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=0,recordsCommitted=13],streamStats=[io.airbyte.config.StreamSyncStats@197c7a50[streamName=bundles,stats=io.airbyte.config.SyncStats@5cb5f528[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=,recordsCommitted=13]]]] 2022-08-19 15:06:31 INFO i.a.w.g.DefaultReplicationWorker(run):268 - Source did not output any state messages 2022-08-19 15:06:31 WARN i.a.w.g.DefaultReplicationWorker(run):279 - State capture: No state retained. 2022-08-19 15:06:31 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:31 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@79a0273f[standardSyncSummary=io.airbyte.config.StandardSyncSummary@5cf7a769[status=completed,recordsSynced=13,bytesSynced=6407,startTime=1660921580894,endTime=1660921591910,totalStats=io.airbyte.config.SyncStats@767358e0[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=0,recordsCommitted=13],streamStats=[io.airbyte.config.StreamSyncStats@197c7a50[streamName=bundles,stats=io.airbyte.config.SyncStats@5cb5f528[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=,recordsCommitted=13]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4de7f9cd[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@778965b3[stream=io.airbyte.protocol.models.AirbyteStream@f683da2[name=bundles,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-04/schema#","required":["id","title","products","image","description","access","created","modified","afterPurchase","price","paymentPlans"],"properties":{"id":{"type":"string"},"image":{"type":["string","null"]},"price":{"type":"integer"},"title":{"type":"string"},"access":{"type":"string"},"created":{"type":"number"},"modified":{"type":"number"},"products":{"type":"object","properties":{"courses":{"type":"array","items":[{"type":"string"}]}}},"description":{"type":["string","null"]},"paymentPlans":{"type":"array","items":[{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"type":"string"},"order":{"type":"integer"},"amount":{"type":"integer"},"status":{"type":"string"},"validTo":{"type":["string","null"]},"validFrom":{"type":["string","null"]},"description":{"type":["string","null"]},"firstAmount":{"type":"integer"},"isCancelable":{"type":"boolean"},"nameOverride":{"type":"boolean"},"paymentsCount":{"type":"integer"},"subscriptionTrialDate":{"type":["string","null"]},"subscriptionTrialDays":{"type":["string","null"]},"subscriptionTrialType":{"type":"string"},"paymentPlanNameOverride":{"type":["string","null"]},"subscriptionIntervalType":{"type":"string"}}}]},"afterPurchase":{"type":"object","properties":{"type":{"type":"string"},"settings":{"type":"object","properties":{"url":{"type":["string","null"]},"page":{"type":["string","null"]}}}}}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-08-19 15:06:31 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-19 15:06:32 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/1/logs.log 2022-08-19 15:06:32 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:06:32 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization. 2022-08-19 15:06:32 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.8 2022-08-19 15:06:32 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.8 exists... 2022-08-19 15:06:32 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.8 was found locally. 2022-08-19 15:06:32 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:32 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/1/normalize --log-driver none --name normalization-normalize-45-1-uamri --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.39.37-alpha airbyte/normalization:0.2.8 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-08-19 15:06:32 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/45/1/normalize 2022-08-19 15:06:32 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/45/1/normalize') 2022-08-19 15:06:32 normalization > transform_bigquery 2022-08-19 15:06:33 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/45/1/normalize --catalog destination_catalog.json --out /data/45/1/normalize/models/generated/ --json-column _airbyte_data 2022-08-19 15:06:33 normalization > Processing destination_catalog.json... 2022-08-19 15:06:33 normalization > {"type": "LOG", "log": {"level": "FATAL", "message": "'list' object has no attribute 'get'\nTraceback (most recent call last):\n File \"/usr/local/bin/transform-catalog\", line 8, in \n sys.exit(main())\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 104, in main\n TransformCatalog().run(args)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 36, in run\n self.process_catalog()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 64, in process_catalog\n processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py\", line 76, in process\n nested_processors = stream_processor.process()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 254, in process\n self.generate_json_parsing_model(from_table, column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 417, in generate_json_parsing_model\n fields=self.extract_json_columns(column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 440, in extract_json_columns\n return [\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 441, in \n self.extract_json_column(field, self.json_column_name, self.properties[field], column_names[field][0], \"table_alias\")\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 459, in extract_json_column\n if is_simple_property(definition.get(\"items\", {\"type\": \"object\"}).get(\"type\", \"object\")):\nAttributeError: 'list' object has no attribute 'get'"}} 2022-08-19 15:06:33 normalization > {"type": "TRACE", "trace": {"type": "ERROR", "emitted_at": 1660921593292.416, "error": {"message": "Something went wrong in the connector. See the logs for more details.", "internal_message": "'list' object has no attribute 'get'", "stack_trace": "Traceback (most recent call last):\n File \"/usr/local/bin/transform-catalog\", line 8, in \n sys.exit(main())\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 104, in main\n TransformCatalog().run(args)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 36, in run\n self.process_catalog()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 64, in process_catalog\n processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py\", line 76, in process\n nested_processors = stream_processor.process()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 254, in process\n self.generate_json_parsing_model(from_table, column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 417, in generate_json_parsing_model\n fields=self.extract_json_columns(column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 440, in extract_json_columns\n return [\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 441, in \n self.extract_json_column(field, self.json_column_name, self.properties[field], column_names[field][0], \"table_alias\")\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 459, in extract_json_column\n if is_simple_property(definition.get(\"items\", {\"type\": \"object\"}).get(\"type\", \"object\")):\nAttributeError: 'list' object has no attribute 'get'\n", "failure_type": "system_error"}}} 2022-08-19 15:06:33 normalization > 2022-08-19 15:06:33 normalization > Showing destination_catalog.json to diagnose/debug errors (1): 2022-08-19 15:06:33 normalization > 2022-08-19 15:06:33 normalization > { 2022-08-19 15:06:33 normalization > "streams": [ 2022-08-19 15:06:33 normalization > { 2022-08-19 15:06:33 normalization > "stream": { 2022-08-19 15:06:33 normalization > "name": "bundles", 2022-08-19 15:06:33 normalization > "json_schema": { 2022-08-19 15:06:33 normalization > "type": "object", 2022-08-19 15:06:33 normalization > "$schema": "http://json-schema.org/draft-04/schema#", 2022-08-19 15:06:33 normalization > "required": [ 2022-08-19 15:06:33 normalization > "id", 2022-08-19 15:06:33 normalization > "title", 2022-08-19 15:06:33 normalization > "products", 2022-08-19 15:06:33 normalization > "image", 2022-08-19 15:06:33 normalization > "description", 2022-08-19 15:06:33 normalization > "access", 2022-08-19 15:06:33 normalization > "created", 2022-08-19 15:06:33 normalization > "modified", 2022-08-19 15:06:33 normalization > "afterPurchase", 2022-08-19 15:06:33 normalization > "price", 2022-08-19 15:06:33 normalization > "paymentPlans" 2022-08-19 15:06:33 normalization > ], 2022-08-19 15:06:33 normalization > "properties": { 2022-08-19 15:06:33 normalization > "id": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "image": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "price": { 2022-08-19 15:06:33 normalization > "type": "integer" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "title": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "access": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "created": { 2022-08-19 15:06:33 normalization > "type": "number" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "modified": { 2022-08-19 15:06:33 normalization > "type": "number" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "products": { 2022-08-19 15:06:33 normalization > "type": "object", 2022-08-19 15:06:33 normalization > "properties": { 2022-08-19 15:06:33 normalization > "courses": { 2022-08-19 15:06:33 normalization > "type": "array", 2022-08-19 15:06:33 normalization > "items": [ 2022-08-19 15:06:33 normalization > { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "description": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "paymentPlans": { 2022-08-19 15:06:33 normalization > "type": "array", 2022-08-19 15:06:33 normalization > "items": [ 2022-08-19 15:06:33 normalization > { 2022-08-19 15:06:33 normalization > "type": "object", 2022-08-19 15:06:33 normalization > "properties": { 2022-08-19 15:06:33 normalization > "id": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "name": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "type": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "order": { 2022-08-19 15:06:33 normalization > "type": "integer" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "amount": { 2022-08-19 15:06:33 normalization > "type": "integer" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "status": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "validTo": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "validFrom": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "description": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "firstAmount": { 2022-08-19 15:06:33 normalization > "type": "integer" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "isCancelable": { 2022-08-19 15:06:33 normalization > "type": "boolean" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "nameOverride": { 2022-08-19 15:06:33 normalization > "type": "boolean" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "paymentsCount": { 2022-08-19 15:06:33 normalization > "type": "integer" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "subscriptionTrialDate": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "subscriptionTrialDays": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "subscriptionTrialType": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "paymentPlanNameOverride": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "subscriptionIntervalType": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "afterPurchase": { 2022-08-19 15:06:33 normalization > "type": "object", 2022-08-19 15:06:33 normalization > "properties": { 2022-08-19 15:06:33 normalization > "type": { 2022-08-19 15:06:33 normalization > "type": "string" 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "settings": { 2022-08-19 15:06:33 normalization > "type": "object", 2022-08-19 15:06:33 normalization > "properties": { 2022-08-19 15:06:33 normalization > "url": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "page": { 2022-08-19 15:06:33 normalization > "type": [ 2022-08-19 15:06:33 normalization > "string", 2022-08-19 15:06:33 normalization > "null" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "supported_sync_modes": [ 2022-08-19 15:06:33 normalization > "full_refresh" 2022-08-19 15:06:33 normalization > ], 2022-08-19 15:06:33 normalization > "default_cursor_field": [], 2022-08-19 15:06:33 normalization > "source_defined_primary_key": [ 2022-08-19 15:06:33 normalization > [ 2022-08-19 15:06:33 normalization > "id" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > }, 2022-08-19 15:06:33 normalization > "sync_mode": "full_refresh", 2022-08-19 15:06:33 normalization > "cursor_field": [], 2022-08-19 15:06:33 normalization > "destination_sync_mode": "overwrite", 2022-08-19 15:06:33 normalization > "primary_key": [ 2022-08-19 15:06:33 normalization > [ 2022-08-19 15:06:33 normalization > "id" 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 normalization > ] 2022-08-19 15:06:33 normalization > } 2022-08-19 15:06:33 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-08-19 15:06:33 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:33 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-19 15:06:33 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=70d5d739-0ead-3779-a2e5-320e5ddd4ce3, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:289) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-08-19 15:06:35 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/2/logs.log 2022-08-19 15:06:35 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:06:35 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if source-learnworlds-connector:1.1.2 exists... 2022-08-19 15:06:35 INFO i.a.c.i.LineGobbler(voidCall):82 - source-learnworlds-connector:1.1.2 was found locally. 2022-08-19 15:06:35 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:35 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/2 --log-driver none --name source-learnworlds-connector-check-45-2-mvoru --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=source-learnworlds-connector:1.1.2 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 source-learnworlds-connector:1.1.2 check --config source_config.json 2022-08-19 15:06:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-08-19 15:06:37 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:37 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/2/logs.log 2022-08-19 15:06:37 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:06:37 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-08-19 15:06:37 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-08-19 15:06:37 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:37 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/2 --log-driver none --name destination-bigquery-check-45-2-klcjx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 airbyte/destination-bigquery:1.1.11 check --config source_config.json 2022-08-19 15:06:38 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-08-19 15:06:38 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:38 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:38 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:38 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-19 15:06:38 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-19 15:06:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:39 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-08-19 15:06:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:39 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:06:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:39 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK 2022-08-19 15:06:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:39 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-08-19 15:06:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:39 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:39 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-08-19 15:06:39 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:06:42 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:43 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/2/logs.log 2022-08-19 15:06:43 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:06:43 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 45 attempt id: 2 2022-08-19 15:06:43 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.bundles=full_refresh - overwrite} 2022-08-19 15:06:43 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-08-19 15:06:43 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:1.1.11 exists... 2022-08-19 15:06:43 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:1.1.11 was found locally. 2022-08-19 15:06:43 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:43 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/2 --log-driver none --name destination-bigquery-write-45-2-ullqt --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.1.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 airbyte/destination-bigquery:1.1.11 write --config destination_config.json --catalog destination_catalog.json 2022-08-19 15:06:43 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if source-learnworlds-connector:1.1.2 exists... 2022-08-19 15:06:43 INFO i.a.c.i.LineGobbler(voidCall):82 - source-learnworlds-connector:1.1.2 was found locally. 2022-08-19 15:06:43 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:43 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/2 --log-driver none --name source-learnworlds-connector-read-45-2-xmcpl --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=source-learnworlds-connector:1.1.2 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=45 source-learnworlds-connector:1.1.2 read --config source_config.json --catalog source_catalog.json 2022-08-19 15:06:43 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-08-19 15:06:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - Destination output thread started. 2022-08-19 15:06:43 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-08-19 15:06:44 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-08-19 15:06:44 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:44 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:44 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-08-19 15:06:44 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-08-19 15:06:44 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 INFO i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 INFO i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:06:44 destination > 2022-08-19 15:06:44 WARN i.a.i.d.b.BigQueryDestination(getConsumer):197 - The "standard" upload mode is not performant, and is not recommended for production. Please use the GCS upload mode if you are syncing a large amount of data. 2022-08-19 15:06:45 source > Starting syncing SourceLearnworldsConnector 2022-08-19 15:06:45 source > Syncing stream: bundles 2022-08-19 15:06:45 destination > 2022-08-19 15:06:45 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):304 - Selected loading method is set to: STANDARD 2022-08-19 15:06:45 source > Read 13 records from bundles stream 2022-08-19 15:06:45 source > Finished syncing bundles 2022-08-19 15:06:45 source > SourceLearnworldsConnector runtimes: Syncing stream bundles 0:00:00.705333 2022-08-19 15:06:45 source > Finished syncing SourceLearnworldsConnector 2022-08-19 15:06:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):327 - Source has no more messages, closing connection. 2022-08-19 15:06:46 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):335 - Total records read: 13 (6 KB) 2022-08-19 15:06:46 INFO i.a.w.g.DefaultReplicationWorker(run):174 - One of source or destination thread complete. Waiting on the other. 2022-08-19 15:06:46 destination > 2022-08-19 15:06:46 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):131 - Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_tmp_rbw_bundles}} 2022-08-19 15:06:48 destination > 2022-08-19 15:06:48 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-08-19 15:06:48 destination > 2022-08-19 15:06:48 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-08-19 15:06:48 destination > 2022-08-19 15:06:48 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):78 - Closing connector: AbstractBigQueryUploader{table=_airbyte_raw_bundles, tmpTable=_airbyte_tmp_rbw_bundles, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-08-19 15:06:49 destination > 2022-08-19 15:06:49 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):325 - Waiting for job finish Job{job=JobId{project=g4-data, job=3f4886e9-312a-4c95-abb4-8b5e58b23427, location=us-east1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1660921606012, endTime=null, startTime=1660921606206, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-learnworlds@g4-data.iam.gserviceaccount.com, etag=jd5KUoUNkj+OC91lNKbg8A==, generatedId=g4-data:us-east1.3f4886e9-312a-4c95-abb4-8b5e58b23427, selfLink=https://www.googleapis.com/bigquery/v2/projects/g4-data/jobs/3f4886e9-312a-4c95-abb4-8b5e58b23427?location=us-east1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, projectId=g4-data, tableId=_airbyte_tmp_rbw_bundles}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-08-19 15:06:52 destination > 2022-08-19 15:06:52 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):327 - Job finish Job{job=JobId{project=g4-data, job=3f4886e9-312a-4c95-abb4-8b5e58b23427, location=us-east1}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1660921606012, endTime=null, startTime=1660921606206, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=airbyte-learnworlds@g4-data.iam.gserviceaccount.com, etag=jd5KUoUNkj+OC91lNKbg8A==, generatedId=g4-data:us-east1.3f4886e9-312a-4c95-abb4-8b5e58b23427, selfLink=https://www.googleapis.com/bigquery/v2/projects/g4-data/jobs/3f4886e9-312a-4c95-abb4-8b5e58b23427?location=us-east1, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, projectId=g4-data, tableId=_airbyte_tmp_rbw_bundles}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-08-19 15:06:52 destination > 2022-08-19 15:06:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):95 - Uploading data from the tmp table _airbyte_tmp_rbw_bundles to the source table _airbyte_raw_bundles. 2022-08-19 15:06:52 destination > 2022-08-19 15:06:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):120 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-08-19 15:06:53 destination > 2022-08-19 15:06:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):185 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_tmp_rbw_bundles}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=LEARNWORLDS_BRUTEf, tableId=_airbyte_raw_bundles}} 2022-08-19 15:06:53 destination > 2022-08-19 15:06:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):97 - Data is successfully loaded to the source table _airbyte_raw_bundles! 2022-08-19 15:06:53 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-08-19 15:06:53 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-08-19 15:06:53 destination > 2022-08-19 15:06:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):99 - Final state message is accepted. 2022-08-19 15:06:53 destination > 2022-08-19 15:06:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):111 - Removing tmp tables... 2022-08-19 15:06:53 destination > 2022-08-19 15:06:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):113 - Finishing destination process...completed 2022-08-19 15:06:53 destination > 2022-08-19 15:06:53 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):85 - Closed connector: AbstractBigQueryUploader{table=_airbyte_raw_bundles, tmpTable=_airbyte_tmp_rbw_bundles, syncMode=WRITE_TRUNCATE, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-08-19 15:06:53 destination > 2022-08-19 15:06:53 INFO i.a.i.b.IntegrationRunner(runInternal):171 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-08-19 15:06:53 INFO i.a.w.g.DefaultReplicationWorker(run):176 - Source and destination threads complete. 2022-08-19 15:06:53 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@60cae3e5[status=completed,recordsSynced=13,bytesSynced=6407,startTime=1660921603145,endTime=1660921613789,totalStats=io.airbyte.config.SyncStats@776b4259[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=0,recordsCommitted=13],streamStats=[io.airbyte.config.StreamSyncStats@820138d[streamName=bundles,stats=io.airbyte.config.SyncStats@6b1a17ed[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=,recordsCommitted=13]]]] 2022-08-19 15:06:53 INFO i.a.w.g.DefaultReplicationWorker(run):268 - Source did not output any state messages 2022-08-19 15:06:53 WARN i.a.w.g.DefaultReplicationWorker(run):279 - State capture: No state retained. 2022-08-19 15:06:53 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:53 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@71f10a9e[standardSyncSummary=io.airbyte.config.StandardSyncSummary@34f38ac4[status=completed,recordsSynced=13,bytesSynced=6407,startTime=1660921603145,endTime=1660921613789,totalStats=io.airbyte.config.SyncStats@776b4259[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=0,recordsCommitted=13],streamStats=[io.airbyte.config.StreamSyncStats@820138d[streamName=bundles,stats=io.airbyte.config.SyncStats@6b1a17ed[recordsEmitted=13,bytesEmitted=6407,stateMessagesEmitted=,recordsCommitted=13]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4459ba5[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@58d3aaa[stream=io.airbyte.protocol.models.AirbyteStream@7cd1757f[name=bundles,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-04/schema#","required":["id","title","products","image","description","access","created","modified","afterPurchase","price","paymentPlans"],"properties":{"id":{"type":"string"},"image":{"type":["string","null"]},"price":{"type":"integer"},"title":{"type":"string"},"access":{"type":"string"},"created":{"type":"number"},"modified":{"type":"number"},"products":{"type":"object","properties":{"courses":{"type":"array","items":[{"type":"string"}]}}},"description":{"type":["string","null"]},"paymentPlans":{"type":"array","items":[{"type":"object","properties":{"id":{"type":"string"},"name":{"type":"string"},"type":{"type":"string"},"order":{"type":"integer"},"amount":{"type":"integer"},"status":{"type":"string"},"validTo":{"type":["string","null"]},"validFrom":{"type":["string","null"]},"description":{"type":["string","null"]},"firstAmount":{"type":"integer"},"isCancelable":{"type":"boolean"},"nameOverride":{"type":"boolean"},"paymentsCount":{"type":"integer"},"subscriptionTrialDate":{"type":["string","null"]},"subscriptionTrialDays":{"type":["string","null"]},"subscriptionTrialType":{"type":"string"},"paymentPlanNameOverride":{"type":["string","null"]},"subscriptionIntervalType":{"type":"string"}}}]},"afterPurchase":{"type":"object","properties":{"type":{"type":"string"},"settings":{"type":"object","properties":{"url":{"type":["string","null"]},"page":{"type":["string","null"]}}}}}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=overwrite,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[]] 2022-08-19 15:06:53 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-19 15:06:53 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/45/2/logs.log 2022-08-19 15:06:53 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-08-19 15:06:53 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization. 2022-08-19 15:06:53 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.8 2022-08-19 15:06:53 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.8 exists... 2022-08-19 15:06:53 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.8 was found locally. 2022-08-19 15:06:53 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 45 2022-08-19 15:06:53 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/45/2/normalize --log-driver none --name normalization-normalize-45-2-zihlr --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.39.37-alpha airbyte/normalization:0.2.8 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-08-19 15:06:54 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/45/2/normalize 2022-08-19 15:06:54 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/45/2/normalize') 2022-08-19 15:06:54 normalization > transform_bigquery 2022-08-19 15:06:54 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/45/2/normalize --catalog destination_catalog.json --out /data/45/2/normalize/models/generated/ --json-column _airbyte_data 2022-08-19 15:06:55 normalization > Processing destination_catalog.json... 2022-08-19 15:06:55 normalization > {"type": "LOG", "log": {"level": "FATAL", "message": "'list' object has no attribute 'get'\nTraceback (most recent call last):\n File \"/usr/local/bin/transform-catalog\", line 8, in \n sys.exit(main())\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 104, in main\n TransformCatalog().run(args)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 36, in run\n self.process_catalog()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 64, in process_catalog\n processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py\", line 76, in process\n nested_processors = stream_processor.process()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 254, in process\n self.generate_json_parsing_model(from_table, column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 417, in generate_json_parsing_model\n fields=self.extract_json_columns(column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 440, in extract_json_columns\n return [\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 441, in \n self.extract_json_column(field, self.json_column_name, self.properties[field], column_names[field][0], \"table_alias\")\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 459, in extract_json_column\n if is_simple_property(definition.get(\"items\", {\"type\": \"object\"}).get(\"type\", \"object\")):\nAttributeError: 'list' object has no attribute 'get'"}} 2022-08-19 15:06:55 normalization > {"type": "TRACE", "trace": {"type": "ERROR", "emitted_at": 1660921615187.311, "error": {"message": "Something went wrong in the connector. See the logs for more details.", "internal_message": "'list' object has no attribute 'get'", "stack_trace": "Traceback (most recent call last):\n File \"/usr/local/bin/transform-catalog\", line 8, in \n sys.exit(main())\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 104, in main\n TransformCatalog().run(args)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 36, in run\n self.process_catalog()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/transform.py\", line 64, in process_catalog\n processor.process(catalog_file=catalog_file, json_column_name=json_col, default_schema=schema)\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/catalog_processor.py\", line 76, in process\n nested_processors = stream_processor.process()\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 254, in process\n self.generate_json_parsing_model(from_table, column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 417, in generate_json_parsing_model\n fields=self.extract_json_columns(column_names),\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 440, in extract_json_columns\n return [\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 441, in \n self.extract_json_column(field, self.json_column_name, self.properties[field], column_names[field][0], \"table_alias\")\n File \"/usr/local/lib/python3.9/site-packages/normalization/transform_catalog/stream_processor.py\", line 459, in extract_json_column\n if is_simple_property(definition.get(\"items\", {\"type\": \"object\"}).get(\"type\", \"object\")):\nAttributeError: 'list' object has no attribute 'get'\n", "failure_type": "system_error"}}} 2022-08-19 15:06:55 normalization > 2022-08-19 15:06:55 normalization > Showing destination_catalog.json to diagnose/debug errors (1): 2022-08-19 15:06:55 normalization > 2022-08-19 15:06:55 normalization > { 2022-08-19 15:06:55 normalization > "streams": [ 2022-08-19 15:06:55 normalization > { 2022-08-19 15:06:55 normalization > "stream": { 2022-08-19 15:06:55 normalization > "name": "bundles", 2022-08-19 15:06:55 normalization > "json_schema": { 2022-08-19 15:06:55 normalization > "type": "object", 2022-08-19 15:06:55 normalization > "$schema": "http://json-schema.org/draft-04/schema#", 2022-08-19 15:06:55 normalization > "required": [ 2022-08-19 15:06:55 normalization > "id", 2022-08-19 15:06:55 normalization > "title", 2022-08-19 15:06:55 normalization > "products", 2022-08-19 15:06:55 normalization > "image", 2022-08-19 15:06:55 normalization > "description", 2022-08-19 15:06:55 normalization > "access", 2022-08-19 15:06:55 normalization > "created", 2022-08-19 15:06:55 normalization > "modified", 2022-08-19 15:06:55 normalization > "afterPurchase", 2022-08-19 15:06:55 normalization > "price", 2022-08-19 15:06:55 normalization > "paymentPlans" 2022-08-19 15:06:55 normalization > ], 2022-08-19 15:06:55 normalization > "properties": { 2022-08-19 15:06:55 normalization > "id": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "image": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "price": { 2022-08-19 15:06:55 normalization > "type": "integer" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "title": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "access": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "created": { 2022-08-19 15:06:55 normalization > "type": "number" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "modified": { 2022-08-19 15:06:55 normalization > "type": "number" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "products": { 2022-08-19 15:06:55 normalization > "type": "object", 2022-08-19 15:06:55 normalization > "properties": { 2022-08-19 15:06:55 normalization > "courses": { 2022-08-19 15:06:55 normalization > "type": "array", 2022-08-19 15:06:55 normalization > "items": [ 2022-08-19 15:06:55 normalization > { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "description": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "paymentPlans": { 2022-08-19 15:06:55 normalization > "type": "array", 2022-08-19 15:06:55 normalization > "items": [ 2022-08-19 15:06:55 normalization > { 2022-08-19 15:06:55 normalization > "type": "object", 2022-08-19 15:06:55 normalization > "properties": { 2022-08-19 15:06:55 normalization > "id": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "name": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "type": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "order": { 2022-08-19 15:06:55 normalization > "type": "integer" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "amount": { 2022-08-19 15:06:55 normalization > "type": "integer" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "status": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "validTo": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "validFrom": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "description": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "firstAmount": { 2022-08-19 15:06:55 normalization > "type": "integer" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "isCancelable": { 2022-08-19 15:06:55 normalization > "type": "boolean" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "nameOverride": { 2022-08-19 15:06:55 normalization > "type": "boolean" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "paymentsCount": { 2022-08-19 15:06:55 normalization > "type": "integer" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "subscriptionTrialDate": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "subscriptionTrialDays": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "subscriptionTrialType": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "paymentPlanNameOverride": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "subscriptionIntervalType": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "afterPurchase": { 2022-08-19 15:06:55 normalization > "type": "object", 2022-08-19 15:06:55 normalization > "properties": { 2022-08-19 15:06:55 normalization > "type": { 2022-08-19 15:06:55 normalization > "type": "string" 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "settings": { 2022-08-19 15:06:55 normalization > "type": "object", 2022-08-19 15:06:55 normalization > "properties": { 2022-08-19 15:06:55 normalization > "url": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "page": { 2022-08-19 15:06:55 normalization > "type": [ 2022-08-19 15:06:55 normalization > "string", 2022-08-19 15:06:55 normalization > "null" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "supported_sync_modes": [ 2022-08-19 15:06:55 normalization > "full_refresh" 2022-08-19 15:06:55 normalization > ], 2022-08-19 15:06:55 normalization > "default_cursor_field": [], 2022-08-19 15:06:55 normalization > "source_defined_primary_key": [ 2022-08-19 15:06:55 normalization > [ 2022-08-19 15:06:55 normalization > "id" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > }, 2022-08-19 15:06:55 normalization > "sync_mode": "full_refresh", 2022-08-19 15:06:55 normalization > "cursor_field": [], 2022-08-19 15:06:55 normalization > "destination_sync_mode": "overwrite", 2022-08-19 15:06:55 normalization > "primary_key": [ 2022-08-19 15:06:55 normalization > [ 2022-08-19 15:06:55 normalization > "id" 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 normalization > ] 2022-08-19 15:06:55 normalization > } 2022-08-19 15:06:55 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):161 - Completing future exceptionally... io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 3 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] 2022-08-19 15:06:55 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-08-19 15:06:55 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-08-19 15:06:55 WARN i.t.i.a.POJOActivityTaskHandler(activityFailureToResult):307 - Activity failure. ActivityId=0ada35b1-8b41-37eb-9acd-d3d16acebb73, activityType=Normalize, attempt=1 java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:289) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:75) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:214) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:180) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.activity.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:120) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:204) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:164) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.8.1.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:56) ~[temporal-serviceclient-1.8.1.jar:?] at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:448) ~[temporal-sdk-1.8.1.jar:?] at io.temporal.activity.Activity.wrap(Activity.java:51) ~[temporal-sdk-1.8.1.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:138) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 14 more Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:132) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:103) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:284) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 14 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:63) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed. at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:60) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] ... 1 more Suppressed: io.airbyte.workers.exception.WorkerException: Normalization process wasn't successful at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:162) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:48) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:21) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?]