2022-07-31 22:29:23 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/0/logs.log 2022-07-31 22:29:23 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:29:23 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-instagram:0.1.9 exists... 2022-07-31 22:29:24 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-instagram:0.1.9 was found locally. 2022-07-31 22:29:24 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:29:24 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/0 --log-driver none --name source-instagram-check-6838-0-ngfnp --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-instagram:0.1.9 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/source-instagram:0.1.9 check --config source_config.json 2022-07-31 22:29:26 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Available accounts: [{'page_id': '193779584728577', 'instagram_business_account': { "id": "17841440443047068" }}] 2022-07-31 22:29:26 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-07-31 22:29:26 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:29:26 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/0/logs.log 2022-07-31 22:29:26 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:29:26 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:0.6.11 exists... 2022-07-31 22:29:26 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:0.6.11 was found locally. 2022-07-31 22:29:26 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:29:26 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/0 --log-driver none --name destination-bigquery-check-6838-0-cgjtu --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:0.6.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/destination-bigquery:0.6.11 check --config source_config.json 2022-07-31 22:29:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-07-31 22:29:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:29:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:29:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-31 22:29:27 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-31 22:29:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:29:29 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-07-31 22:29:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:29:29 INFO i.a.i.b.IntegrationRunner(run):103 - Sentry transaction event: 130a34fefad04beba1d59ddfdfcdd1c6 2022-07-31 22:29:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:29:29 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:29:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:29:29 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: CHECK 2022-07-31 22:29:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:29:29 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-07-31 22:29:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:29:29 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:29:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:29:29 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:29:29 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:29:29 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:29:31 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:29:32 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/0/logs.log 2022-07-31 22:29:32 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:29:32 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 6838 attempt id: 0 2022-07-31 22:29:32 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.media_insights=full_refresh - append, null.stories=full_refresh - append, null.story_insights=full_refresh - append, null.user_lifetime_insights=full_refresh - append, null.users=full_refresh - append, null.media=full_refresh - append, null.user_insights=full_refresh - append} 2022-07-31 22:29:32 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-07-31 22:29:32 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:0.6.11 exists... 2022-07-31 22:29:32 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:29:32 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/0 --log-driver none --name destination-bigquery-write-6838-0-hdyut --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:0.6.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/destination-bigquery:0.6.11 write --config destination_config.json --catalog destination_catalog.json 2022-07-31 22:29:32 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:0.6.11 was found locally. 2022-07-31 22:29:32 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-instagram:0.1.9 exists... 2022-07-31 22:29:32 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:29:32 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/0 --log-driver none --name source-instagram-read-6838-0-mcfju --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-instagram:0.1.9 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/source-instagram:0.1.9 read --config source_config.json --catalog source_catalog.json 2022-07-31 22:29:32 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-instagram:0.1.9 was found locally. 2022-07-31 22:29:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - Destination output thread started. 2022-07-31 22:29:32 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-07-31 22:29:32 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-07-31 22:29:33 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-07-31 22:29:33 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:29:33 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:29:33 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-31 22:29:33 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-31 22:29:34 source > Starting syncing SourceInstagram 2022-07-31 22:29:34 source > Syncing stream: media 2022-07-31 22:29:34 destination > 2022-07-31 22:29:34 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-07-31 22:29:34 destination > 2022-07-31 22:29:34 INFO i.a.i.b.IntegrationRunner(run):103 - Sentry transaction event: 4bb219d7ab114acda8e320a49cafeef8 2022-07-31 22:29:34 destination > 2022-07-31 22:29:34 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:29:34 destination > 2022-07-31 22:29:34 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-07-31 22:29:34 destination > 2022-07-31 22:29:34 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-07-31 22:29:35 destination > 2022-07-31 22:29:35 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:29:35 destination > 2022-07-31 22:29:35 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:29:35 destination > 2022-07-31 22:29:35 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:29:36 destination > 2022-07-31 22:29:36 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_qpb_media}} created successfully 2022-07-31 22:29:37 destination > 2022-07-31 22:29:37 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:29:37 destination > 2022-07-31 22:29:37 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_qqq_media_insights}} created successfully 2022-07-31 22:29:37 destination > 2022-07-31 22:29:37 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:29:38 destination > 2022-07-31 22:29:38 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_uvt_stories}} created successfully 2022-07-31 22:29:38 destination > 2022-07-31 22:29:38 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:29:38 destination > 2022-07-31 22:29:38 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_gsl_story_insights}} created successfully 2022-07-31 22:29:39 destination > 2022-07-31 22:29:39 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:29:39 destination > 2022-07-31 22:29:39 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_jhz_user_insights}} created successfully 2022-07-31 22:29:39 destination > 2022-07-31 22:29:39 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:29:40 destination > 2022-07-31 22:29:40 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_yvd_user_lifetime_insights}} created successfully 2022-07-31 22:29:40 destination > 2022-07-31 22:29:40 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:29:40 destination > 2022-07-31 22:29:40 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_ocx_users}} created successfully 2022-07-31 22:30:52 source > /usr/local/lib/python3.7/site-packages/facebook_business/utils/api_utils.py:30: UserWarning: media does not allow field children 2022-07-31 22:30:52 source > warnings.warn(message) 2022-07-31 22:30:52 source > Read 580 records from media stream 2022-07-31 22:30:52 source > Syncing stream: media_insights 2022-07-31 22:30:52 source > Encountered an exception while reading stream SourceInstagram Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 104, in read internal_config=internal_config, File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 134, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 206, in _read_full_refresh for record in records: File "/airbyte/integration_code/source_instagram/streams.py", line 336, in read_records insights = self._get_insights(ig_media, account_id) File "/airbyte/integration_code/source_instagram/streams.py", line 366, in _get_insights raise error File "/airbyte/integration_code/source_instagram/streams.py", line 355, in _get_insights insights = item.get_insights(params={"metric": metrics}) File "/usr/local/lib/python3.7/site-packages/facebook_business/adobjects/igmedia.py", line 251, in get_insights return request.execute() File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 677, in execute cursor.load_next_page() File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 844, in load_next_page params=self.params, File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry ret = target(*args, **kwargs) File "/airbyte/integration_code/source_instagram/api.py", line 61, in call response = super().call(method, path, params, headers, files, url_override, api_version) File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 350, in call raise fb_response.error() facebook_business.exceptions.FacebookRequestError: Message: Call was not successful Method: GET Path: https://graph.facebook.com/v11.0/17965439194753658/insights Params: {'metric': '["engagement","impressions","reach","saved","video_views"]'} Status: 400 Response: { "error": { "message": "(#100) Incompatible metrics (engagement, impressions, video_views) with reel media", "type": "OAuthException", "code": 100, "fbtrace_id": "AHDPFXic4qgR6nQnGm8TjIf" } } 2022-07-31 22:30:52 source > Traceback (most recent call last): 2022-07-31 22:30:52 source > File "/airbyte/integration_code/main.py", line 13, in 2022-07-31 22:30:52 source > launch(source, sys.argv[1:]) 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 105, in launch 2022-07-31 22:30:52 source > for message in source_entrypoint.run(parsed_args): 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 96, in run 2022-07-31 22:30:52 source > for message in generator: 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 108, in read 2022-07-31 22:30:52 source > raise e 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 104, in read 2022-07-31 22:30:52 source > internal_config=internal_config, 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 134, in _read_stream 2022-07-31 22:30:52 source > for record in record_iterator: 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 206, in _read_full_refresh 2022-07-31 22:30:52 source > for record in records: 2022-07-31 22:30:52 source > File "/airbyte/integration_code/source_instagram/streams.py", line 336, in read_records 2022-07-31 22:30:52 source > insights = self._get_insights(ig_media, account_id) 2022-07-31 22:30:52 source > File "/airbyte/integration_code/source_instagram/streams.py", line 366, in _get_insights 2022-07-31 22:30:52 source > raise error 2022-07-31 22:30:52 source > File "/airbyte/integration_code/source_instagram/streams.py", line 355, in _get_insights 2022-07-31 22:30:52 source > insights = item.get_insights(params={"metric": metrics}) 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/adobjects/igmedia.py", line 251, in get_insights 2022-07-31 22:30:52 source > return request.execute() 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 677, in execute 2022-07-31 22:30:52 source > cursor.load_next_page() 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 844, in load_next_page 2022-07-31 22:30:52 source > params=self.params, 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry 2022-07-31 22:30:52 source > ret = target(*args, **kwargs) 2022-07-31 22:30:52 source > File "/airbyte/integration_code/source_instagram/api.py", line 61, in call 2022-07-31 22:30:52 source > response = super().call(method, path, params, headers, files, url_override, api_version) 2022-07-31 22:30:52 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 350, in call 2022-07-31 22:30:52 source > raise fb_response.error() 2022-07-31 22:30:52 source > facebook_business.exceptions.FacebookRequestError: 2022-07-31 22:30:52 source > 2022-07-31 22:30:52 source > Message: Call was not successful 2022-07-31 22:30:52 source > Method: GET 2022-07-31 22:30:52 source > Path: https://graph.facebook.com/v11.0/17965439194753658/insights 2022-07-31 22:30:52 source > Params: {'metric': '["engagement","impressions","reach","saved","video_views"]'} 2022-07-31 22:30:52 source > 2022-07-31 22:30:52 source > Status: 400 2022-07-31 22:30:52 source > Response: 2022-07-31 22:30:52 source > { 2022-07-31 22:30:52 source > "error": { 2022-07-31 22:30:52 source > "message": "(#100) Incompatible metrics (engagement, impressions, video_views) with reel media", 2022-07-31 22:30:52 source > "type": "OAuthException", 2022-07-31 22:30:52 source > "code": 100, 2022-07-31 22:30:52 source > "fbtrace_id": "AHDPFXic4qgR6nQnGm8TjIf" 2022-07-31 22:30:52 source > } 2022-07-31 22:30:52 source > } 2022-07-31 22:30:52 source > 2022-07-31 22:30:52 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):327 - Source has no more messages, closing connection. 2022-07-31 22:30:52 destination > 2022-07-31 22:30:52 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-07-31 22:30:52 destination > 2022-07-31 22:30:52 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-07-31 22:30:52 destination > 2022-07-31 22:30:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:30:52 destination > 2022-07-31 22:30:52 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:30:52 destination > 2022-07-31 22:30:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_user_lifetime_insights, tmpTable=_airbyte_tmp_yvd_user_lifetime_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:30:52 destination > 2022-07-31 22:30:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_yvd_user_lifetime_insights to the source table _airbyte_raw_user_lifetime_insights. 2022-07-31 22:30:52 destination > 2022-07-31 22:30:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_yvd_user_lifetime_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_user_lifetime_insights}} 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_user_lifetime_insights! 2022-07-31 22:30:55 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:30:55 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_user_lifetime_insights, tmpTable=_airbyte_tmp_yvd_user_lifetime_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_stories, tmpTable=_airbyte_tmp_uvt_stories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_uvt_stories to the source table _airbyte_raw_stories. 2022-07-31 22:30:55 destination > 2022-07-31 22:30:55 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:30:56 destination > 2022-07-31 22:30:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_uvt_stories}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_stories}} 2022-07-31 22:30:56 destination > 2022-07-31 22:30:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_stories! 2022-07-31 22:30:56 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:30:56 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:30:56 destination > 2022-07-31 22:30:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:30:56 destination > 2022-07-31 22:30:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:30:57 destination > 2022-07-31 22:30:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:30:57 destination > 2022-07-31 22:30:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_stories, tmpTable=_airbyte_tmp_uvt_stories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:30:57 destination > 2022-07-31 22:30:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:30:57 destination > 2022-07-31 22:30:57 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:30:57 destination > 2022-07-31 22:30:57 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_media, tmpTable=_airbyte_tmp_qpb_media, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:30:58 destination > 2022-07-31 22:30:58 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):304 - Waiting for job finish Job{job=JobId{project=bettersaver-production, job=8e79ac65-96c8-439c-8180-6c7a13d09d1b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659306657645, endTime=null, startTime=1659306657935, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=big-query-admin@bettersaver-production.iam.gserviceaccount.com, etag=scAtmi0VycuqiYi+f8thcg==, generatedId=bettersaver-production:US.8e79ac65-96c8-439c-8180-6c7a13d09d1b, selfLink=https://www.googleapis.com/bigquery/v2/projects/bettersaver-production/jobs/8e79ac65-96c8-439c-8180-6c7a13d09d1b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, projectId=bettersaver-production, tableId=_airbyte_tmp_qpb_media}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-31 22:31:00 destination > 2022-07-31 22:31:00 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):306 - Job finish Job{job=JobId{project=bettersaver-production, job=8e79ac65-96c8-439c-8180-6c7a13d09d1b, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659306657645, endTime=null, startTime=1659306657935, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=big-query-admin@bettersaver-production.iam.gserviceaccount.com, etag=scAtmi0VycuqiYi+f8thcg==, generatedId=bettersaver-production:US.8e79ac65-96c8-439c-8180-6c7a13d09d1b, selfLink=https://www.googleapis.com/bigquery/v2/projects/bettersaver-production/jobs/8e79ac65-96c8-439c-8180-6c7a13d09d1b?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, projectId=bettersaver-production, tableId=_airbyte_tmp_qpb_media}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-31 22:31:00 destination > 2022-07-31 22:31:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_qpb_media to the source table _airbyte_raw_media. 2022-07-31 22:31:00 destination > 2022-07-31 22:31:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_qpb_media}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_media}} 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_media! 2022-07-31 22:31:03 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:31:03 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_media, tmpTable=_airbyte_tmp_qpb_media, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_story_insights, tmpTable=_airbyte_tmp_gsl_story_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_gsl_story_insights to the source table _airbyte_raw_story_insights. 2022-07-31 22:31:03 destination > 2022-07-31 22:31:03 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_gsl_story_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_story_insights}} 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_story_insights! 2022-07-31 22:31:07 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:31:07 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_story_insights, tmpTable=_airbyte_tmp_gsl_story_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_user_insights, tmpTable=_airbyte_tmp_jhz_user_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_jhz_user_insights to the source table _airbyte_raw_user_insights. 2022-07-31 22:31:07 destination > 2022-07-31 22:31:07 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:31:08 destination > 2022-07-31 22:31:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_jhz_user_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_user_insights}} 2022-07-31 22:31:08 destination > 2022-07-31 22:31:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_user_insights! 2022-07-31 22:31:08 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:31:08 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:31:08 destination > 2022-07-31 22:31:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:31:08 destination > 2022-07-31 22:31:08 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:31:09 destination > 2022-07-31 22:31:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:31:09 destination > 2022-07-31 22:31:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_user_insights, tmpTable=_airbyte_tmp_jhz_user_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:09 destination > 2022-07-31 22:31:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:31:09 destination > 2022-07-31 22:31:09 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:31:09 destination > 2022-07-31 22:31:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_media_insights, tmpTable=_airbyte_tmp_qqq_media_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:09 destination > 2022-07-31 22:31:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_qqq_media_insights to the source table _airbyte_raw_media_insights. 2022-07-31 22:31:09 destination > 2022-07-31 22:31:09 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_qqq_media_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_media_insights}} 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_media_insights! 2022-07-31 22:31:13 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:31:13 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_media_insights, tmpTable=_airbyte_tmp_qqq_media_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_users, tmpTable=_airbyte_tmp_ocx_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_ocx_users to the source table _airbyte_raw_users. 2022-07-31 22:31:13 destination > 2022-07-31 22:31:13 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:31:14 destination > 2022-07-31 22:31:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_ocx_users}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_users}} 2022-07-31 22:31:14 destination > 2022-07-31 22:31:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_users! 2022-07-31 22:31:14 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:31:14 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:31:14 destination > 2022-07-31 22:31:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:31:14 destination > 2022-07-31 22:31:14 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:31:15 destination > 2022-07-31 22:31:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:31:15 destination > 2022-07-31 22:31:15 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_users, tmpTable=_airbyte_tmp_ocx_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:31:15 destination > 2022-07-31 22:31:15 INFO i.a.i.b.IntegrationRunner(runInternal):169 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:31:15 ERROR i.a.w.g.DefaultReplicationWorker(run):180 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:173) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:137) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:331) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:329) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-07-31 22:31:15 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@654821b0[status=failed,recordsSynced=580,bytesSynced=1061023,startTime=1659306572097,endTime=1659306675205,totalStats=io.airbyte.config.SyncStats@219276a9[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@59a3b07c[streamName=media,stats=io.airbyte.config.SyncStats@3e12c871[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=,recordsCommitted=]]]] 2022-07-31 22:31:15 INFO i.a.w.g.DefaultReplicationWorker(run):268 - Source did not output any state messages 2022-07-31 22:31:15 WARN i.a.w.g.DefaultReplicationWorker(run):279 - State capture: No state retained. 2022-07-31 22:31:15 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:31:15 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@6ae278e2[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2fe0ebda[status=failed,recordsSynced=580,bytesSynced=1061023,startTime=1659306572097,endTime=1659306675205,totalStats=io.airbyte.config.SyncStats@219276a9[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@59a3b07c[streamName=media,stats=io.airbyte.config.SyncStats@3e12c871[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=,recordsCommitted=]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@1fd6fb37[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@1e05c3c5[stream=io.airbyte.protocol.models.AirbyteStream@67d98d8f[name=media,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"caption":{"type":["null","string"]},"page_id":{"type":["null","string"]},"children":{"type":["null","array"],"items":{"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]}}}},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"like_count":{"type":["null","integer"]},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]},"comments_count":{"type":["null","integer"]},"is_comment_enabled":{"type":["null","boolean"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4fcf1495[stream=io.airbyte.protocol.models.AirbyteStream@67685118[name=media_insights,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"reach":{"type":["null","integer"]},"saved":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"engagement":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"video_views":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]},"carousel_album_reach":{"type":["null","integer"]},"carousel_album_saved":{"type":["null","integer"]},"carousel_album_engagement":{"type":["null","integer"]},"carousel_album_impressions":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5743bddb[stream=io.airbyte.protocol.models.AirbyteStream@7cdde749[name=stories,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"caption":{"type":["null","string"]},"page_id":{"type":["null","string"]},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"like_count":{"type":["null","integer"]},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@4b812ffb[stream=io.airbyte.protocol.models.AirbyteStream@6ec44702[name=story_insights,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"exits":{"type":["null","integer"]},"reach":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"replies":{"type":["null","integer"]},"taps_back":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"taps_forward":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@24a38264[stream=io.airbyte.protocol.models.AirbyteStream@3757de16[name=user_insights,jsonSchema={"type":"object","properties":{"date":{"type":["null","string"],"format":"date-time"},"reach":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"reach_week":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"profile_views":{"type":["null","integer"]},"reach_days_28":{"type":["null","integer"]},"follower_count":{"type":["null","integer"]},"website_clicks":{"type":["null","integer"]},"impressions_week":{"type":["null","integer"]},"online_followers":{"type":["null","object"]},"phone_call_clicks":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]},"impressions_days_28":{"type":["null","integer"]},"text_message_clicks":{"type":["null","integer"]},"get_directions_clicks":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date],sourceDefinedPrimaryKey=[],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[date],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@756bc1f0[stream=io.airbyte.protocol.models.AirbyteStream@39db6408[name=user_lifetime_insights,jsonSchema={"type":"object","properties":{"date":{"type":["null","string"],"format":"date-time"},"value":{"type":["integer","object"]},"metric":{"type":["null","string"]},"page_id":{"type":["null","string"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1d371f5[stream=io.airbyte.protocol.models.AirbyteStream@87da8b7[name=users,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"name":{"type":["null","string"]},"ig_id":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"website":{"type":["null","string"]},"username":{"type":["null","string"]},"biography":{"type":["null","string"]},"media_count":{"type":["null","integer"]},"follows_count":{"type":["null","integer"]},"followers_count":{"type":["null","integer"]},"profile_picture_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@23329c09[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@412b5743[additionalProperties={attemptNumber=0, jobId=6838}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:331) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:329) ... 4 more ,retryable=,timestamp=1659306652810]]] 2022-07-31 22:31:15 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-07-31 22:31:15 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/0/logs.log 2022-07-31 22:31:15 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:31:15 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization. 2022-07-31 22:31:15 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.8 2022-07-31 22:31:15 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.8 exists... 2022-07-31 22:31:15 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.8 was found locally. 2022-07-31 22:31:15 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:31:15 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/0/normalize --log-driver none --name normalization-normalize-6838-0-tigwm --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.39.37-alpha airbyte/normalization:0.2.8 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-07-31 22:31:15 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/6838/0/normalize 2022-07-31 22:31:16 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/6838/0/normalize') 2022-07-31 22:31:16 normalization > transform_bigquery 2022-07-31 22:31:16 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/6838/0/normalize --catalog destination_catalog.json --out /data/6838/0/normalize/models/generated/ --json-column _airbyte_data 2022-07-31 22:31:17 normalization > Processing destination_catalog.json... 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_ab1.sql from media 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_ab2.sql from media 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_ab3.sql from media 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/media.sql from media 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_insights_ab1.sql from media_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_insights_ab2.sql from media_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_insights_ab3.sql from media_insights 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/media_insights.sql from media_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/stories_ab1.sql from stories 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/stories_ab2.sql from stories 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/stories_ab3.sql from stories 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/stories.sql from stories 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/story_insights_ab1.sql from story_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/story_insights_ab2.sql from story_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/story_insights_ab3.sql from story_insights 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/story_insights.sql from story_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/user_insights_ab1.sql from user_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/user_insights_ab2.sql from user_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/user_insights_ab3.sql from user_insights 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/user_insights.sql from user_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab1.sql from user_lifetime_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab2.sql from user_lifetime_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab3.sql from user_lifetime_insights 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/user_lifetime_insights.sql from user_lifetime_insights 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/users_ab1.sql from users 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/users_ab2.sql from users 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/users_ab3.sql from users 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/users.sql from users 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_owner_ab1.sql from media/owner 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_owner_ab2.sql from media/owner 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_owner_ab3.sql from media/owner 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/media_owner.sql from media/owner 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_children_ab1.sql from media/children 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_children_ab2.sql from media/children 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_children_ab3.sql from media/children 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/media_children.sql from media/children 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/stories_owner_ab1.sql from stories/owner 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/stories_owner_ab2.sql from stories/owner 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/stories_owner_ab3.sql from stories/owner 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/stories_owner.sql from stories/owner 2022-07-31 22:31:17 normalization > Ignoring stream 'value' from user_lifetime_insights/value because properties list is empty 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab1.sql from media/children/owner 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab2.sql from media/children/owner 2022-07-31 22:31:17 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab3.sql from media/children/owner 2022-07-31 22:31:17 normalization > Generating airbyte_incremental/instagram/media_children_owner.sql from media/children/owner 2022-07-31 22:31:17 normalization > detected no config file for ssh, assuming ssh is off. 2022-07-31 22:31:20 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-07-31 22:31:20 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-07-31 22:31:20 normalization > 2022-07-31 22:31:20 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-07-31 22:31:20 normalization > 2022-07-31 22:31:24 normalization > 22:31:24 Running with dbt=1.0.0 2022-07-31 22:31:24 normalization > 22:31:24 Partial parse save file not found. Starting full parse. 2022-07-31 22:31:26 normalization > 22:31:26 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-07-31 22:31:26 normalization > There are 2 unused configuration paths: 2022-07-31 22:31:26 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-07-31 22:31:26 normalization > - models.airbyte_utils.generated.airbyte_views 2022-07-31 22:31:26 normalization > 2022-07-31 22:31:26 normalization > 22:31:26 Found 44 models, 0 tests, 0 snapshots, 0 analyses, 553 macros, 0 operations, 0 seed files, 7 sources, 0 exposures, 0 metrics 2022-07-31 22:31:26 normalization > 22:31:26 2022-07-31 22:31:27 normalization > 22:31:27 Concurrency: 8 threads (target='prod') 2022-07-31 22:31:27 normalization > 22:31:27 2022-07-31 22:31:28 normalization > 22:31:28 1 of 11 START incremental model instagram.story_insights................................................................ [RUN] 2022-07-31 22:31:28 normalization > 22:31:28 5 of 11 START incremental model instagram.users......................................................................... [RUN] 2022-07-31 22:31:28 normalization > 22:31:28 2 of 11 START incremental model instagram.media_insights................................................................ [RUN] 2022-07-31 22:31:28 normalization > 22:31:28 3 of 11 START incremental model instagram.stories....................................................................... [RUN] 2022-07-31 22:31:28 normalization > 22:31:28 6 of 11 START incremental model instagram.user_lifetime_insights........................................................ [RUN] 2022-07-31 22:31:28 normalization > 22:31:28 4 of 11 START incremental model instagram.user_insights................................................................. [RUN] 2022-07-31 22:31:28 normalization > 22:31:28 7 of 11 START incremental model instagram.media......................................................................... [RUN] 2022-07-31 22:31:34 normalization > 22:31:34 5 of 11 OK created incremental model instagram.users.................................................................... [MERGE (1.0 rows, 36.8 KB processed) in 6.22s] 2022-07-31 22:31:35 normalization > 22:31:35 6 of 11 OK created incremental model instagram.user_lifetime_insights................................................... [MERGE (4.0 rows, 147.9 KB processed) in 6.52s] 2022-07-31 22:31:35 normalization > 22:31:35 1 of 11 OK created incremental model instagram.story_insights........................................................... [MERGE (3.0 rows, 96.6 KB processed) in 6.71s] 2022-07-31 22:31:35 normalization > 22:31:35 3 of 11 OK created incremental model instagram.stories.................................................................. [MERGE (1.0 rows, 101.3 KB processed) in 6.55s] 2022-07-31 22:31:35 normalization > 22:31:35 2 of 11 OK created incremental model instagram.media_insights........................................................... [MERGE (1.0 rows, 7.8 MB processed) in 6.67s] 2022-07-31 22:31:35 normalization > 22:31:35 4 of 11 OK created incremental model instagram.user_insights............................................................ [MERGE (1.0 rows, 1.0 MB processed) in 6.91s] 2022-07-31 22:31:35 normalization > 22:31:35 8 of 11 START incremental model instagram.stories_owner................................................................. [RUN] 2022-07-31 22:31:36 normalization > 22:31:36 7 of 11 OK created incremental model instagram.media.................................................................... [MERGE (582.0 rows, 10.4 MB processed) in 7.57s] 2022-07-31 22:31:37 normalization > 22:31:37 9 of 11 START incremental model instagram.media_owner................................................................... [RUN] 2022-07-31 22:31:37 normalization > 22:31:37 10 of 11 START incremental model instagram.media_children............................................................... [RUN] 2022-07-31 22:31:41 normalization > 22:31:41 8 of 11 OK created incremental model instagram.stories_owner............................................................ [MERGE (1.0 rows, 141.0 Bytes processed) in 5.58s] 2022-07-31 22:31:42 normalization > 22:31:42 9 of 11 OK created incremental model instagram.media_owner.............................................................. [MERGE (582.0 rows, 80.1 KB processed) in 5.47s] 2022-07-31 22:31:43 normalization > 22:31:43 10 of 11 OK created incremental model instagram.media_children.......................................................... [MERGE (463.0 rows, 263.6 KB processed) in 5.74s] 2022-07-31 22:31:43 normalization > 22:31:43 11 of 11 START incremental model instagram.media_children_owner......................................................... [RUN] 2022-07-31 22:31:48 normalization > 22:31:48 11 of 11 OK created incremental model instagram.media_children_owner.................................................... [MERGE (469.0 rows, 64.6 KB processed) in 5.03s] 2022-07-31 22:31:48 normalization > 22:31:48 2022-07-31 22:31:48 normalization > 22:31:48 Finished running 11 incremental models in 21.70s. 2022-07-31 22:31:48 normalization > 22:31:48 2022-07-31 22:31:48 normalization > 22:31:48 Completed successfully 2022-07-31 22:31:48 normalization > 22:31:48 2022-07-31 22:31:48 normalization > 22:31:48 Done. PASS=11 WARN=0 ERROR=0 SKIP=0 TOTAL=11 2022-07-31 22:31:49 INFO i.a.w.g.DefaultNormalizationWorker(run):73 - Normalization executed in 33 seconds. 2022-07-31 22:31:49 INFO i.a.w.g.DefaultNormalizationWorker(run):79 - Normalization summary: io.airbyte.config.NormalizationSummary@1a7f27b0[startTime=1659306675314,endTime=1659306709015] 2022-07-31 22:31:49 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:31:49 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-07-31 22:31:49 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/1/logs.log 2022-07-31 22:31:49 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:31:49 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-instagram:0.1.9 exists... 2022-07-31 22:31:49 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-instagram:0.1.9 was found locally. 2022-07-31 22:31:49 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:31:49 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/1 --log-driver none --name source-instagram-check-6838-1-khmkf --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/source-instagram:0.1.9 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/source-instagram:0.1.9 check --config source_config.json 2022-07-31 22:31:50 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Available accounts: [{'page_id': '193779584728577', 'instagram_business_account': { "id": "17841440443047068" }}] 2022-07-31 22:31:50 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-07-31 22:31:50 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:31:50 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/1/logs.log 2022-07-31 22:31:50 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:31:50 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:0.6.11 exists... 2022-07-31 22:31:50 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:31:50 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:0.6.11 was found locally. 2022-07-31 22:31:50 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/1 --log-driver none --name destination-bigquery-check-6838-1-suuui --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:0.6.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/destination-bigquery:0.6.11 check --config source_config.json 2022-07-31 22:31:51 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-07-31 22:31:51 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:31:51 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:31:51 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-31 22:31:51 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-31 22:31:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:31:52 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-07-31 22:31:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:31:52 INFO i.a.i.b.IntegrationRunner(run):103 - Sentry transaction event: 8476513755724d39b7ef3f0fa817e659 2022-07-31 22:31:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:31:52 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:31:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:31:52 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: CHECK 2022-07-31 22:31:52 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:31:52 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-07-31 22:31:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:31:53 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:31:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:31:53 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:31:53 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:31:53 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:31:55 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:31:55 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/1/logs.log 2022-07-31 22:31:55 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:31:55 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 6838 attempt id: 1 2022-07-31 22:31:55 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.media_insights=full_refresh - append, null.stories=full_refresh - append, null.story_insights=full_refresh - append, null.user_lifetime_insights=full_refresh - append, null.users=full_refresh - append, null.media=full_refresh - append, null.user_insights=full_refresh - append} 2022-07-31 22:31:55 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-07-31 22:31:55 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:0.6.11 exists... 2022-07-31 22:31:55 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:0.6.11 was found locally. 2022-07-31 22:31:55 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:31:55 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/1 --log-driver none --name destination-bigquery-write-6838-1-tshmj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:0.6.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/destination-bigquery:0.6.11 write --config destination_config.json --catalog destination_catalog.json 2022-07-31 22:31:55 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-instagram:0.1.9 exists... 2022-07-31 22:31:55 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-instagram:0.1.9 was found locally. 2022-07-31 22:31:55 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:31:55 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/1 --log-driver none --name source-instagram-read-6838-1-lahtb --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=1 -e WORKER_CONNECTOR_IMAGE=airbyte/source-instagram:0.1.9 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/source-instagram:0.1.9 read --config source_config.json --catalog source_catalog.json 2022-07-31 22:31:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - Destination output thread started. 2022-07-31 22:31:55 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-07-31 22:31:55 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-07-31 22:31:56 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-07-31 22:31:56 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:31:56 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:31:56 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-31 22:31:56 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-31 22:31:58 destination > 2022-07-31 22:31:58 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-07-31 22:31:58 destination > 2022-07-31 22:31:58 INFO i.a.i.b.IntegrationRunner(run):103 - Sentry transaction event: e21b789255b341b79baea742b55d166c 2022-07-31 22:31:58 destination > 2022-07-31 22:31:58 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:31:58 destination > 2022-07-31 22:31:58 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-07-31 22:31:58 destination > 2022-07-31 22:31:58 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-07-31 22:31:58 destination > 2022-07-31 22:31:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:31:58 destination > 2022-07-31 22:31:58 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:31:58 destination > 2022-07-31 22:31:58 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:31:58 source > Starting syncing SourceInstagram 2022-07-31 22:31:58 source > Syncing stream: media 2022-07-31 22:31:59 destination > 2022-07-31 22:31:59 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_evw_media}} created successfully 2022-07-31 22:32:00 destination > 2022-07-31 22:32:00 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:32:00 destination > 2022-07-31 22:32:00 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_jyy_media_insights}} created successfully 2022-07-31 22:32:00 destination > 2022-07-31 22:32:00 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:32:01 destination > 2022-07-31 22:32:01 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_stt_stories}} created successfully 2022-07-31 22:32:01 destination > 2022-07-31 22:32:01 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:32:01 destination > 2022-07-31 22:32:01 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_rfo_story_insights}} created successfully 2022-07-31 22:32:01 destination > 2022-07-31 22:32:01 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:32:02 destination > 2022-07-31 22:32:02 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_xrc_user_insights}} created successfully 2022-07-31 22:32:02 destination > 2022-07-31 22:32:02 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:32:02 destination > 2022-07-31 22:32:02 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_svz_user_lifetime_insights}} created successfully 2022-07-31 22:32:02 destination > 2022-07-31 22:32:02 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:32:03 destination > 2022-07-31 22:32:03 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_slw_users}} created successfully 2022-07-31 22:33:16 source > /usr/local/lib/python3.7/site-packages/facebook_business/utils/api_utils.py:30: UserWarning: media does not allow field children 2022-07-31 22:33:16 source > warnings.warn(message) 2022-07-31 22:33:16 source > Read 580 records from media stream 2022-07-31 22:33:16 source > Syncing stream: media_insights 2022-07-31 22:33:16 source > Encountered an exception while reading stream SourceInstagram Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 104, in read internal_config=internal_config, File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 134, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 206, in _read_full_refresh for record in records: File "/airbyte/integration_code/source_instagram/streams.py", line 336, in read_records insights = self._get_insights(ig_media, account_id) File "/airbyte/integration_code/source_instagram/streams.py", line 366, in _get_insights raise error File "/airbyte/integration_code/source_instagram/streams.py", line 355, in _get_insights insights = item.get_insights(params={"metric": metrics}) File "/usr/local/lib/python3.7/site-packages/facebook_business/adobjects/igmedia.py", line 251, in get_insights return request.execute() File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 677, in execute cursor.load_next_page() File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 844, in load_next_page params=self.params, File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry ret = target(*args, **kwargs) File "/airbyte/integration_code/source_instagram/api.py", line 61, in call response = super().call(method, path, params, headers, files, url_override, api_version) File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 350, in call raise fb_response.error() facebook_business.exceptions.FacebookRequestError: Message: Call was not successful Method: GET Path: https://graph.facebook.com/v11.0/17965439194753658/insights Params: {'metric': '["engagement","impressions","reach","saved","video_views"]'} Status: 400 Response: { "error": { "message": "(#100) Incompatible metrics (engagement, impressions, video_views) with reel media", "type": "OAuthException", "code": 100, "fbtrace_id": "Aw4zfkP2yKu8hb58QEetAhk" } } 2022-07-31 22:33:16 source > Traceback (most recent call last): 2022-07-31 22:33:16 source > File "/airbyte/integration_code/main.py", line 13, in 2022-07-31 22:33:16 source > launch(source, sys.argv[1:]) 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 105, in launch 2022-07-31 22:33:16 source > for message in source_entrypoint.run(parsed_args): 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 96, in run 2022-07-31 22:33:16 source > for message in generator: 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 108, in read 2022-07-31 22:33:16 source > raise e 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 104, in read 2022-07-31 22:33:16 source > internal_config=internal_config, 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 134, in _read_stream 2022-07-31 22:33:16 source > for record in record_iterator: 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 206, in _read_full_refresh 2022-07-31 22:33:16 source > for record in records: 2022-07-31 22:33:16 source > File "/airbyte/integration_code/source_instagram/streams.py", line 336, in read_records 2022-07-31 22:33:16 source > insights = self._get_insights(ig_media, account_id) 2022-07-31 22:33:16 source > File "/airbyte/integration_code/source_instagram/streams.py", line 366, in _get_insights 2022-07-31 22:33:16 source > raise error 2022-07-31 22:33:16 source > File "/airbyte/integration_code/source_instagram/streams.py", line 355, in _get_insights 2022-07-31 22:33:16 source > insights = item.get_insights(params={"metric": metrics}) 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/adobjects/igmedia.py", line 251, in get_insights 2022-07-31 22:33:16 source > return request.execute() 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 677, in execute 2022-07-31 22:33:16 source > cursor.load_next_page() 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 844, in load_next_page 2022-07-31 22:33:16 source > params=self.params, 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry 2022-07-31 22:33:16 source > ret = target(*args, **kwargs) 2022-07-31 22:33:16 source > File "/airbyte/integration_code/source_instagram/api.py", line 61, in call 2022-07-31 22:33:16 source > response = super().call(method, path, params, headers, files, url_override, api_version) 2022-07-31 22:33:16 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 350, in call 2022-07-31 22:33:16 source > raise fb_response.error() 2022-07-31 22:33:16 source > facebook_business.exceptions.FacebookRequestError: 2022-07-31 22:33:16 source > 2022-07-31 22:33:16 source > Message: Call was not successful 2022-07-31 22:33:16 source > Method: GET 2022-07-31 22:33:16 source > Path: https://graph.facebook.com/v11.0/17965439194753658/insights 2022-07-31 22:33:16 source > Params: {'metric': '["engagement","impressions","reach","saved","video_views"]'} 2022-07-31 22:33:16 source > 2022-07-31 22:33:16 source > Status: 400 2022-07-31 22:33:16 source > Response: 2022-07-31 22:33:16 source > { 2022-07-31 22:33:16 source > "error": { 2022-07-31 22:33:16 source > "message": "(#100) Incompatible metrics (engagement, impressions, video_views) with reel media", 2022-07-31 22:33:16 source > "type": "OAuthException", 2022-07-31 22:33:16 source > "code": 100, 2022-07-31 22:33:16 source > "fbtrace_id": "Aw4zfkP2yKu8hb58QEetAhk" 2022-07-31 22:33:16 source > } 2022-07-31 22:33:16 source > } 2022-07-31 22:33:16 source > 2022-07-31 22:33:17 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):335 - Total records read: 580 (1 MB) 2022-07-31 22:33:17 destination > 2022-07-31 22:33:17 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-07-31 22:33:17 destination > 2022-07-31 22:33:17 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-07-31 22:33:17 destination > 2022-07-31 22:33:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:33:17 destination > 2022-07-31 22:33:17 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:33:17 destination > 2022-07-31 22:33:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_user_lifetime_insights, tmpTable=_airbyte_tmp_svz_user_lifetime_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:17 destination > 2022-07-31 22:33:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_svz_user_lifetime_insights to the source table _airbyte_raw_user_lifetime_insights. 2022-07-31 22:33:17 destination > 2022-07-31 22:33:17 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_svz_user_lifetime_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_user_lifetime_insights}} 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_user_lifetime_insights! 2022-07-31 22:33:19 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:33:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_user_lifetime_insights, tmpTable=_airbyte_tmp_svz_user_lifetime_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_stories, tmpTable=_airbyte_tmp_stt_stories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_stt_stories to the source table _airbyte_raw_stories. 2022-07-31 22:33:19 destination > 2022-07-31 22:33:19 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_stt_stories}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_stories}} 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_stories! 2022-07-31 22:33:21 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:33:21 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_stories, tmpTable=_airbyte_tmp_stt_stories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:33:21 destination > 2022-07-31 22:33:21 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_media, tmpTable=_airbyte_tmp_evw_media, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:22 destination > 2022-07-31 22:33:22 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):304 - Waiting for job finish Job{job=JobId{project=bettersaver-production, job=c4325c84-f6c6-4611-89b9-6ed97760492a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659306801839, endTime=null, startTime=1659306802075, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=big-query-admin@bettersaver-production.iam.gserviceaccount.com, etag=OZjPU3bs0m+FeGdUBlGxxA==, generatedId=bettersaver-production:US.c4325c84-f6c6-4611-89b9-6ed97760492a, selfLink=https://www.googleapis.com/bigquery/v2/projects/bettersaver-production/jobs/c4325c84-f6c6-4611-89b9-6ed97760492a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, projectId=bettersaver-production, tableId=_airbyte_tmp_evw_media}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-31 22:33:25 destination > 2022-07-31 22:33:25 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):306 - Job finish Job{job=JobId{project=bettersaver-production, job=c4325c84-f6c6-4611-89b9-6ed97760492a, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659306801839, endTime=null, startTime=1659306802075, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=big-query-admin@bettersaver-production.iam.gserviceaccount.com, etag=OZjPU3bs0m+FeGdUBlGxxA==, generatedId=bettersaver-production:US.c4325c84-f6c6-4611-89b9-6ed97760492a, selfLink=https://www.googleapis.com/bigquery/v2/projects/bettersaver-production/jobs/c4325c84-f6c6-4611-89b9-6ed97760492a?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, projectId=bettersaver-production, tableId=_airbyte_tmp_evw_media}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-31 22:33:25 destination > 2022-07-31 22:33:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_evw_media to the source table _airbyte_raw_media. 2022-07-31 22:33:25 destination > 2022-07-31 22:33:25 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_evw_media}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_media}} 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_media! 2022-07-31 22:33:28 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:33:28 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_media, tmpTable=_airbyte_tmp_evw_media, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_story_insights, tmpTable=_airbyte_tmp_rfo_story_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_rfo_story_insights to the source table _airbyte_raw_story_insights. 2022-07-31 22:33:28 destination > 2022-07-31 22:33:28 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_rfo_story_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_story_insights}} 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_story_insights! 2022-07-31 22:33:31 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:33:31 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_story_insights, tmpTable=_airbyte_tmp_rfo_story_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_user_insights, tmpTable=_airbyte_tmp_xrc_user_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_xrc_user_insights to the source table _airbyte_raw_user_insights. 2022-07-31 22:33:31 destination > 2022-07-31 22:33:31 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_xrc_user_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_user_insights}} 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_user_insights! 2022-07-31 22:33:35 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:33:35 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_user_insights, tmpTable=_airbyte_tmp_xrc_user_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_media_insights, tmpTable=_airbyte_tmp_jyy_media_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_jyy_media_insights to the source table _airbyte_raw_media_insights. 2022-07-31 22:33:35 destination > 2022-07-31 22:33:35 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_jyy_media_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_media_insights}} 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_media_insights! 2022-07-31 22:33:39 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:33:39 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_media_insights, tmpTable=_airbyte_tmp_jyy_media_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_users, tmpTable=_airbyte_tmp_slw_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_slw_users to the source table _airbyte_raw_users. 2022-07-31 22:33:39 destination > 2022-07-31 22:33:39 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:33:42 destination > 2022-07-31 22:33:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_slw_users}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_users}} 2022-07-31 22:33:42 destination > 2022-07-31 22:33:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_users! 2022-07-31 22:33:42 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:33:42 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:33:42 destination > 2022-07-31 22:33:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:33:42 destination > 2022-07-31 22:33:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:33:42 destination > 2022-07-31 22:33:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:33:42 destination > 2022-07-31 22:33:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_users, tmpTable=_airbyte_tmp_slw_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:33:42 destination > 2022-07-31 22:33:42 INFO i.a.i.b.IntegrationRunner(runInternal):169 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:33:42 ERROR i.a.w.g.DefaultReplicationWorker(run):180 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:173) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:137) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:348) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-07-31 22:33:42 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@40bf7b2e[status=failed,recordsSynced=580,bytesSynced=1061023,startTime=1659306715368,endTime=1659306822479,totalStats=io.airbyte.config.SyncStats@b8c1e54[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@1fd34a0[streamName=media,stats=io.airbyte.config.SyncStats@52a8119c[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=,recordsCommitted=]]]] 2022-07-31 22:33:42 INFO i.a.w.g.DefaultReplicationWorker(run):268 - Source did not output any state messages 2022-07-31 22:33:42 WARN i.a.w.g.DefaultReplicationWorker(run):279 - State capture: No state retained. 2022-07-31 22:33:42 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:33:42 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@7a23c585[standardSyncSummary=io.airbyte.config.StandardSyncSummary@3f2144a5[status=failed,recordsSynced=580,bytesSynced=1061023,startTime=1659306715368,endTime=1659306822479,totalStats=io.airbyte.config.SyncStats@b8c1e54[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@1fd34a0[streamName=media,stats=io.airbyte.config.SyncStats@52a8119c[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=,recordsCommitted=]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@12a0e9b2[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@e543dc6[stream=io.airbyte.protocol.models.AirbyteStream@6a3fce64[name=media,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"caption":{"type":["null","string"]},"page_id":{"type":["null","string"]},"children":{"type":["null","array"],"items":{"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]}}}},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"like_count":{"type":["null","integer"]},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]},"comments_count":{"type":["null","integer"]},"is_comment_enabled":{"type":["null","boolean"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5f0ebbea[stream=io.airbyte.protocol.models.AirbyteStream@4af634c0[name=media_insights,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"reach":{"type":["null","integer"]},"saved":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"engagement":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"video_views":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]},"carousel_album_reach":{"type":["null","integer"]},"carousel_album_saved":{"type":["null","integer"]},"carousel_album_engagement":{"type":["null","integer"]},"carousel_album_impressions":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@65639a55[stream=io.airbyte.protocol.models.AirbyteStream@713b2473[name=stories,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"caption":{"type":["null","string"]},"page_id":{"type":["null","string"]},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"like_count":{"type":["null","integer"]},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5b400055[stream=io.airbyte.protocol.models.AirbyteStream@206b6fc9[name=story_insights,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"exits":{"type":["null","integer"]},"reach":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"replies":{"type":["null","integer"]},"taps_back":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"taps_forward":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@5923e8a3[stream=io.airbyte.protocol.models.AirbyteStream@71135748[name=user_insights,jsonSchema={"type":"object","properties":{"date":{"type":["null","string"],"format":"date-time"},"reach":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"reach_week":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"profile_views":{"type":["null","integer"]},"reach_days_28":{"type":["null","integer"]},"follower_count":{"type":["null","integer"]},"website_clicks":{"type":["null","integer"]},"impressions_week":{"type":["null","integer"]},"online_followers":{"type":["null","object"]},"phone_call_clicks":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]},"impressions_days_28":{"type":["null","integer"]},"text_message_clicks":{"type":["null","integer"]},"get_directions_clicks":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date],sourceDefinedPrimaryKey=[],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[date],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@2a0aa397[stream=io.airbyte.protocol.models.AirbyteStream@51648438[name=user_lifetime_insights,jsonSchema={"type":"object","properties":{"date":{"type":["null","string"],"format":"date-time"},"value":{"type":["integer","object"]},"metric":{"type":["null","string"]},"page_id":{"type":["null","string"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@17c40847[stream=io.airbyte.protocol.models.AirbyteStream@7c06b4e0[name=users,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"name":{"type":["null","string"]},"ig_id":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"website":{"type":["null","string"]},"username":{"type":["null","string"]},"biography":{"type":["null","string"]},"media_count":{"type":["null","integer"]},"follows_count":{"type":["null","integer"]},"followers_count":{"type":["null","integer"]},"profile_picture_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@3efb6ec[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@765fa7ed[additionalProperties={attemptNumber=1, jobId=6838}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:348) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1659306797067]]] 2022-07-31 22:33:42 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-07-31 22:33:42 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/1/logs.log 2022-07-31 22:33:42 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:33:42 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization. 2022-07-31 22:33:42 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.8 2022-07-31 22:33:42 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.8 exists... 2022-07-31 22:33:42 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:33:42 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/1/normalize --log-driver none --name normalization-normalize-6838-1-jagyz --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.39.37-alpha airbyte/normalization:0.2.8 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-07-31 22:33:42 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.8 was found locally. 2022-07-31 22:33:42 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/6838/1/normalize 2022-07-31 22:33:43 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/6838/1/normalize') 2022-07-31 22:33:43 normalization > transform_bigquery 2022-07-31 22:33:43 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/6838/1/normalize --catalog destination_catalog.json --out /data/6838/1/normalize/models/generated/ --json-column _airbyte_data 2022-07-31 22:33:44 normalization > Processing destination_catalog.json... 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_ab1.sql from media 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_ab2.sql from media 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_ab3.sql from media 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/media.sql from media 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_insights_ab1.sql from media_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_insights_ab2.sql from media_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_insights_ab3.sql from media_insights 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/media_insights.sql from media_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/stories_ab1.sql from stories 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/stories_ab2.sql from stories 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/stories_ab3.sql from stories 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/stories.sql from stories 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/story_insights_ab1.sql from story_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/story_insights_ab2.sql from story_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/story_insights_ab3.sql from story_insights 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/story_insights.sql from story_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/user_insights_ab1.sql from user_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/user_insights_ab2.sql from user_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/user_insights_ab3.sql from user_insights 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/user_insights.sql from user_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab1.sql from user_lifetime_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab2.sql from user_lifetime_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab3.sql from user_lifetime_insights 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/user_lifetime_insights.sql from user_lifetime_insights 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/users_ab1.sql from users 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/users_ab2.sql from users 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/users_ab3.sql from users 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/users.sql from users 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_owner_ab1.sql from media/owner 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_owner_ab2.sql from media/owner 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_owner_ab3.sql from media/owner 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/media_owner.sql from media/owner 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_children_ab1.sql from media/children 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_children_ab2.sql from media/children 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_children_ab3.sql from media/children 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/media_children.sql from media/children 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/stories_owner_ab1.sql from stories/owner 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/stories_owner_ab2.sql from stories/owner 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/stories_owner_ab3.sql from stories/owner 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/stories_owner.sql from stories/owner 2022-07-31 22:33:44 normalization > Ignoring stream 'value' from user_lifetime_insights/value because properties list is empty 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab1.sql from media/children/owner 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab2.sql from media/children/owner 2022-07-31 22:33:44 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab3.sql from media/children/owner 2022-07-31 22:33:44 normalization > Generating airbyte_incremental/instagram/media_children_owner.sql from media/children/owner 2022-07-31 22:33:44 normalization > detected no config file for ssh, assuming ssh is off. 2022-07-31 22:33:46 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-07-31 22:33:46 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-07-31 22:33:46 normalization > 2022-07-31 22:33:46 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-07-31 22:33:46 normalization > 2022-07-31 22:33:50 normalization > 22:33:50 Running with dbt=1.0.0 2022-07-31 22:33:50 normalization > 22:33:50 Partial parse save file not found. Starting full parse. 2022-07-31 22:33:52 normalization > 22:33:52 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-07-31 22:33:52 normalization > There are 2 unused configuration paths: 2022-07-31 22:33:52 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-07-31 22:33:52 normalization > - models.airbyte_utils.generated.airbyte_views 2022-07-31 22:33:52 normalization > 2022-07-31 22:33:52 normalization > 22:33:52 Found 44 models, 0 tests, 0 snapshots, 0 analyses, 553 macros, 0 operations, 0 seed files, 7 sources, 0 exposures, 0 metrics 2022-07-31 22:33:52 normalization > 22:33:52 2022-07-31 22:33:52 normalization > 22:33:52 Concurrency: 8 threads (target='prod') 2022-07-31 22:33:52 normalization > 22:33:52 2022-07-31 22:33:53 normalization > 22:33:53 1 of 11 START incremental model instagram.user_insights................................................................. [RUN] 2022-07-31 22:33:54 normalization > 22:33:54 2 of 11 START incremental model instagram.story_insights................................................................ [RUN] 2022-07-31 22:33:54 normalization > 22:33:54 3 of 11 START incremental model instagram.stories....................................................................... [RUN] 2022-07-31 22:33:54 normalization > 22:33:54 4 of 11 START incremental model instagram.media......................................................................... [RUN] 2022-07-31 22:33:54 normalization > 22:33:54 5 of 11 START incremental model instagram.user_lifetime_insights........................................................ [RUN] 2022-07-31 22:33:54 normalization > 22:33:54 6 of 11 START incremental model instagram.users......................................................................... [RUN] 2022-07-31 22:33:54 normalization > 22:33:54 7 of 11 START incremental model instagram.media_insights................................................................ [RUN] 2022-07-31 22:33:59 normalization > 22:33:59 7 of 11 OK created incremental model instagram.media_insights........................................................... [MERGE (1.0 rows, 7.8 MB processed) in 5.55s] 2022-07-31 22:33:59 normalization > 22:33:59 5 of 11 OK created incremental model instagram.user_lifetime_insights................................................... [MERGE (4.0 rows, 147.9 KB processed) in 5.83s] 2022-07-31 22:33:59 normalization > 22:33:59 3 of 11 OK created incremental model instagram.stories.................................................................. [MERGE (1.0 rows, 101.3 KB processed) in 5.92s] 2022-07-31 22:34:00 normalization > 22:34:00 6 of 11 OK created incremental model instagram.users.................................................................... [MERGE (1.0 rows, 36.8 KB processed) in 5.91s] 2022-07-31 22:34:00 normalization > 22:34:00 2 of 11 OK created incremental model instagram.story_insights........................................................... [MERGE (3.0 rows, 96.6 KB processed) in 6.02s] 2022-07-31 22:34:00 normalization > 22:34:00 8 of 11 START incremental model instagram.stories_owner................................................................. [RUN] 2022-07-31 22:34:00 normalization > 22:34:00 1 of 11 OK created incremental model instagram.user_insights............................................................ [MERGE (1.0 rows, 1.0 MB processed) in 6.67s] 2022-07-31 22:34:00 normalization > 22:34:00 4 of 11 OK created incremental model instagram.media.................................................................... [MERGE (582.0 rows, 10.4 MB processed) in 6.78s] 2022-07-31 22:34:01 normalization > 22:34:01 9 of 11 START incremental model instagram.media_owner................................................................... [RUN] 2022-07-31 22:34:01 normalization > 22:34:01 10 of 11 START incremental model instagram.media_children............................................................... [RUN] 2022-07-31 22:34:05 normalization > 22:34:05 8 of 11 OK created incremental model instagram.stories_owner............................................................ [MERGE (1.0 rows, 141.0 Bytes processed) in 4.84s] 2022-07-31 22:34:06 normalization > 22:34:06 10 of 11 OK created incremental model instagram.media_children.......................................................... [MERGE (463.0 rows, 263.6 KB processed) in 4.86s] 2022-07-31 22:34:06 normalization > 22:34:06 9 of 11 OK created incremental model instagram.media_owner.............................................................. [MERGE (582.0 rows, 80.1 KB processed) in 5.17s] 2022-07-31 22:34:06 normalization > 22:34:06 11 of 11 START incremental model instagram.media_children_owner......................................................... [RUN] 2022-07-31 22:34:11 normalization > 22:34:11 11 of 11 OK created incremental model instagram.media_children_owner.................................................... [MERGE (469.0 rows, 64.6 KB processed) in 4.92s] 2022-07-31 22:34:11 normalization > 22:34:11 2022-07-31 22:34:11 normalization > 22:34:11 Finished running 11 incremental models in 19.04s. 2022-07-31 22:34:11 normalization > 22:34:11 2022-07-31 22:34:11 normalization > 22:34:11 Completed successfully 2022-07-31 22:34:11 normalization > 22:34:11 2022-07-31 22:34:11 normalization > 22:34:11 Done. PASS=11 WARN=0 ERROR=0 SKIP=0 TOTAL=11 2022-07-31 22:34:11 INFO i.a.w.g.DefaultNormalizationWorker(run):73 - Normalization executed in 29 seconds. 2022-07-31 22:34:11 INFO i.a.w.g.DefaultNormalizationWorker(run):79 - Normalization summary: io.airbyte.config.NormalizationSummary@407ecb66[startTime=1659306822579,endTime=1659306851999] 2022-07-31 22:34:11 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:34:12 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-07-31 22:34:12 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/2/logs.log 2022-07-31 22:34:12 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:34:12 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-instagram:0.1.9 exists... 2022-07-31 22:34:12 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-instagram:0.1.9 was found locally. 2022-07-31 22:34:12 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:34:12 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/2 --log-driver none --name source-instagram-check-6838-2-yacaf --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/source-instagram:0.1.9 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/source-instagram:0.1.9 check --config source_config.json 2022-07-31 22:34:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Available accounts: [{'page_id': '193779584728577', 'instagram_business_account': { "id": "17841440443047068" }}] 2022-07-31 22:34:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):97 - Check succeeded 2022-07-31 22:34:14 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:34:14 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/2/logs.log 2022-07-31 22:34:14 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:34:14 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:0.6.11 exists... 2022-07-31 22:34:14 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:0.6.11 was found locally. 2022-07-31 22:34:14 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:34:14 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/2 --log-driver none --name destination-bigquery-check-6838-2-qutyv --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:0.6.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/destination-bigquery:0.6.11 check --config source_config.json 2022-07-31 22:34:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings. 2022-07-31 22:34:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:34:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:34:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-31 22:34:15 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-31 22:34:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:34:16 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json} 2022-07-31 22:34:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:34:16 INFO i.a.i.b.IntegrationRunner(run):103 - Sentry transaction event: 0f7e8eaf561e426b84f10b7d48e7ed5d 2022-07-31 22:34:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:34:16 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:34:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:34:16 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: CHECK 2022-07-31 22:34:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:34:16 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-07-31 22:34:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:34:16 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:34:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:34:16 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:34:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$0):61 - 2022-07-31 22:34:16 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:34:18 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:34:19 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/2/logs.log 2022-07-31 22:34:19 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:34:19 INFO i.a.w.g.DefaultReplicationWorker(run):115 - start sync worker. job id: 6838 attempt id: 2 2022-07-31 22:34:19 INFO i.a.w.g.DefaultReplicationWorker(run):127 - configured sync modes: {null.media_insights=full_refresh - append, null.stories=full_refresh - append, null.story_insights=full_refresh - append, null.user_lifetime_insights=full_refresh - append, null.users=full_refresh - append, null.media=full_refresh - append, null.user_insights=full_refresh - append} 2022-07-31 22:34:19 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-07-31 22:34:19 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:0.6.11 exists... 2022-07-31 22:34:19 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:0.6.11 was found locally. 2022-07-31 22:34:19 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:34:19 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/2 --log-driver none --name destination-bigquery-write-6838-2-ovmtr --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:0.6.11 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/destination-bigquery:0.6.11 write --config destination_config.json --catalog destination_catalog.json 2022-07-31 22:34:19 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-instagram:0.1.9 exists... 2022-07-31 22:34:19 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-instagram:0.1.9 was found locally. 2022-07-31 22:34:19 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:34:19 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/2 --log-driver none --name source-instagram-read-6838-2-oebbl --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=false -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_JOB_ATTEMPT=2 -e WORKER_CONNECTOR_IMAGE=airbyte/source-instagram:0.1.9 -e AIRBYTE_VERSION=0.39.37-alpha -e WORKER_JOB_ID=6838 airbyte/source-instagram:0.1.9 read --config source_config.json --catalog source_catalog.json 2022-07-31 22:34:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):405 - Destination output thread started. 2022-07-31 22:34:19 INFO i.a.w.g.DefaultReplicationWorker(run):169 - Waiting for source and destination threads to complete. 2022-07-31 22:34:19 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):298 - Replication thread started. 2022-07-31 22:34:20 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-07-31 22:34:20 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:34:20 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-07-31 22:34:20 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-07-31 22:34:20 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-07-31 22:34:21 destination > 2022-07-31 22:34:21 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-07-31 22:34:21 destination > 2022-07-31 22:34:21 INFO i.a.i.b.IntegrationRunner(run):103 - Sentry transaction event: 4277a08f53b34ae68ca32a4865b4da1e 2022-07-31 22:34:21 source > Starting syncing SourceInstagram 2022-07-31 22:34:21 source > Syncing stream: media 2022-07-31 22:34:21 destination > 2022-07-31 22:34:21 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:34:21 destination > 2022-07-31 22:34:21 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-07-31 22:34:21 destination > 2022-07-31 22:34:21 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-07-31 22:34:22 destination > 2022-07-31 22:34:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:34:22 destination > 2022-07-31 22:34:22 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-07-31 22:34:22 destination > 2022-07-31 22:34:22 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:34:23 destination > 2022-07-31 22:34:23 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_blx_media}} created successfully 2022-07-31 22:34:23 destination > 2022-07-31 22:34:23 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:34:24 destination > 2022-07-31 22:34:24 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_jta_media_insights}} created successfully 2022-07-31 22:34:24 destination > 2022-07-31 22:34:24 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:34:24 destination > 2022-07-31 22:34:24 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_cpk_stories}} created successfully 2022-07-31 22:34:24 destination > 2022-07-31 22:34:24 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:34:25 destination > 2022-07-31 22:34:25 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_gnq_story_insights}} created successfully 2022-07-31 22:34:25 destination > 2022-07-31 22:34:25 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:34:25 destination > 2022-07-31 22:34:25 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_hnw_user_insights}} created successfully 2022-07-31 22:34:25 destination > 2022-07-31 22:34:25 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:34:26 destination > 2022-07-31 22:34:26 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_hiw_user_lifetime_insights}} created successfully 2022-07-31 22:34:26 destination > 2022-07-31 22:34:26 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-07-31 22:34:26 destination > 2022-07-31 22:34:26 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_amp_users}} created successfully 2022-07-31 22:35:36 source > /usr/local/lib/python3.7/site-packages/facebook_business/utils/api_utils.py:30: UserWarning: media does not allow field children 2022-07-31 22:35:36 source > warnings.warn(message) 2022-07-31 22:35:36 source > Read 580 records from media stream 2022-07-31 22:35:36 source > Syncing stream: media_insights 2022-07-31 22:35:36 source > Encountered an exception while reading stream SourceInstagram Traceback (most recent call last): File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 104, in read internal_config=internal_config, File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 134, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 206, in _read_full_refresh for record in records: File "/airbyte/integration_code/source_instagram/streams.py", line 336, in read_records insights = self._get_insights(ig_media, account_id) File "/airbyte/integration_code/source_instagram/streams.py", line 366, in _get_insights raise error File "/airbyte/integration_code/source_instagram/streams.py", line 355, in _get_insights insights = item.get_insights(params={"metric": metrics}) File "/usr/local/lib/python3.7/site-packages/facebook_business/adobjects/igmedia.py", line 251, in get_insights return request.execute() File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 677, in execute cursor.load_next_page() File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 844, in load_next_page params=self.params, File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry ret = target(*args, **kwargs) File "/airbyte/integration_code/source_instagram/api.py", line 61, in call response = super().call(method, path, params, headers, files, url_override, api_version) File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 350, in call raise fb_response.error() facebook_business.exceptions.FacebookRequestError: Message: Call was not successful Method: GET Path: https://graph.facebook.com/v11.0/17965439194753658/insights Params: {'metric': '["engagement","impressions","reach","saved","video_views"]'} Status: 400 Response: { "error": { "message": "(#100) Incompatible metrics (engagement, impressions, video_views) with reel media", "type": "OAuthException", "code": 100, "fbtrace_id": "ArDPmh88Fnb6J1xT9MsxGp_" } } 2022-07-31 22:35:36 source > Traceback (most recent call last): 2022-07-31 22:35:36 source > File "/airbyte/integration_code/main.py", line 13, in 2022-07-31 22:35:36 source > launch(source, sys.argv[1:]) 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 105, in launch 2022-07-31 22:35:36 source > for message in source_entrypoint.run(parsed_args): 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/entrypoint.py", line 96, in run 2022-07-31 22:35:36 source > for message in generator: 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 108, in read 2022-07-31 22:35:36 source > raise e 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 104, in read 2022-07-31 22:35:36 source > internal_config=internal_config, 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 134, in _read_stream 2022-07-31 22:35:36 source > for record in record_iterator: 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/airbyte_cdk/sources/abstract_source.py", line 206, in _read_full_refresh 2022-07-31 22:35:36 source > for record in records: 2022-07-31 22:35:36 source > File "/airbyte/integration_code/source_instagram/streams.py", line 336, in read_records 2022-07-31 22:35:36 source > insights = self._get_insights(ig_media, account_id) 2022-07-31 22:35:36 source > File "/airbyte/integration_code/source_instagram/streams.py", line 366, in _get_insights 2022-07-31 22:35:36 source > raise error 2022-07-31 22:35:36 source > File "/airbyte/integration_code/source_instagram/streams.py", line 355, in _get_insights 2022-07-31 22:35:36 source > insights = item.get_insights(params={"metric": metrics}) 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/adobjects/igmedia.py", line 251, in get_insights 2022-07-31 22:35:36 source > return request.execute() 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 677, in execute 2022-07-31 22:35:36 source > cursor.load_next_page() 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 844, in load_next_page 2022-07-31 22:35:36 source > params=self.params, 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/backoff/_sync.py", line 94, in retry 2022-07-31 22:35:36 source > ret = target(*args, **kwargs) 2022-07-31 22:35:36 source > File "/airbyte/integration_code/source_instagram/api.py", line 61, in call 2022-07-31 22:35:36 source > response = super().call(method, path, params, headers, files, url_override, api_version) 2022-07-31 22:35:36 source > File "/usr/local/lib/python3.7/site-packages/facebook_business/api.py", line 350, in call 2022-07-31 22:35:36 source > raise fb_response.error() 2022-07-31 22:35:36 source > facebook_business.exceptions.FacebookRequestError: 2022-07-31 22:35:36 source > 2022-07-31 22:35:36 source > Message: Call was not successful 2022-07-31 22:35:36 source > Method: GET 2022-07-31 22:35:36 source > Path: https://graph.facebook.com/v11.0/17965439194753658/insights 2022-07-31 22:35:36 source > Params: {'metric': '["engagement","impressions","reach","saved","video_views"]'} 2022-07-31 22:35:36 source > 2022-07-31 22:35:36 source > Status: 400 2022-07-31 22:35:36 source > Response: 2022-07-31 22:35:36 source > { 2022-07-31 22:35:36 source > "error": { 2022-07-31 22:35:36 source > "message": "(#100) Incompatible metrics (engagement, impressions, video_views) with reel media", 2022-07-31 22:35:36 source > "type": "OAuthException", 2022-07-31 22:35:36 source > "code": 100, 2022-07-31 22:35:36 source > "fbtrace_id": "ArDPmh88Fnb6J1xT9MsxGp_" 2022-07-31 22:35:36 source > } 2022-07-31 22:35:36 source > } 2022-07-31 22:35:36 source > 2022-07-31 22:35:36 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):335 - Total records read: 580 (1 MB) 2022-07-31 22:35:36 destination > 2022-07-31 22:35:36 INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):65 - Airbyte message consumer: succeeded. 2022-07-31 22:35:36 destination > 2022-07-31 22:35:36 INFO i.a.i.d.b.BigQueryRecordConsumer(close):58 - Started closing all connections 2022-07-31 22:35:36 destination > 2022-07-31 22:35:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:35:36 destination > 2022-07-31 22:35:36 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:35:36 destination > 2022-07-31 22:35:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_user_lifetime_insights, tmpTable=_airbyte_tmp_hiw_user_lifetime_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:36 destination > 2022-07-31 22:35:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_hiw_user_lifetime_insights to the source table _airbyte_raw_user_lifetime_insights. 2022-07-31 22:35:36 destination > 2022-07-31 22:35:36 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_hiw_user_lifetime_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_user_lifetime_insights}} 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_user_lifetime_insights! 2022-07-31 22:35:37 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:35:37 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_user_lifetime_insights, tmpTable=_airbyte_tmp_hiw_user_lifetime_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_stories, tmpTable=_airbyte_tmp_cpk_stories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_cpk_stories to the source table _airbyte_raw_stories. 2022-07-31 22:35:37 destination > 2022-07-31 22:35:37 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_cpk_stories}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_stories}} 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_stories! 2022-07-31 22:35:42 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:35:42 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_stories, tmpTable=_airbyte_tmp_cpk_stories, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_media, tmpTable=_airbyte_tmp_blx_media, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:42 destination > 2022-07-31 22:35:42 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):304 - Waiting for job finish Job{job=JobId{project=bettersaver-production, job=6975cd87-20bf-46d6-bf9f-8d697db44ba0, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659306942535, endTime=null, startTime=1659306942748, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=big-query-admin@bettersaver-production.iam.gserviceaccount.com, etag=B8DzrGxEPCsNrOsY7RTJ4Q==, generatedId=bettersaver-production:US.6975cd87-20bf-46d6-bf9f-8d697db44ba0, selfLink=https://www.googleapis.com/bigquery/v2/projects/bettersaver-production/jobs/6975cd87-20bf-46d6-bf9f-8d697db44ba0?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, projectId=bettersaver-production, tableId=_airbyte_tmp_blx_media}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-31 22:35:45 destination > 2022-07-31 22:35:45 INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):306 - Job finish Job{job=JobId{project=bettersaver-production, job=6975cd87-20bf-46d6-bf9f-8d697db44ba0, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1659306942535, endTime=null, startTime=1659306942748, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=big-query-admin@bettersaver-production.iam.gserviceaccount.com, etag=B8DzrGxEPCsNrOsY7RTJ4Q==, generatedId=bettersaver-production:US.6975cd87-20bf-46d6-bf9f-8d697db44ba0, selfLink=https://www.googleapis.com/bigquery/v2/projects/bettersaver-production/jobs/6975cd87-20bf-46d6-bf9f-8d697db44ba0?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, projectId=bettersaver-production, tableId=_airbyte_tmp_blx_media}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=CREATE_IF_NEEDED, writeDisposition=null, formatOptions=FormatOptions{format=NEWLINE_DELIMITED_JSON}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=null, schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=null, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null} 2022-07-31 22:35:45 destination > 2022-07-31 22:35:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_blx_media to the source table _airbyte_raw_media. 2022-07-31 22:35:45 destination > 2022-07-31 22:35:45 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_blx_media}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_media}} 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_media! 2022-07-31 22:35:49 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:35:49 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_media, tmpTable=_airbyte_tmp_blx_media, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_story_insights, tmpTable=_airbyte_tmp_gnq_story_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_gnq_story_insights to the source table _airbyte_raw_story_insights. 2022-07-31 22:35:49 destination > 2022-07-31 22:35:49 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_gnq_story_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_story_insights}} 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_story_insights! 2022-07-31 22:35:52 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:35:52 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_story_insights, tmpTable=_airbyte_tmp_gnq_story_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_user_insights, tmpTable=_airbyte_tmp_hnw_user_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_hnw_user_insights to the source table _airbyte_raw_user_insights. 2022-07-31 22:35:52 destination > 2022-07-31 22:35:52 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_hnw_user_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_user_insights}} 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_user_insights! 2022-07-31 22:35:56 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:35:56 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_user_insights, tmpTable=_airbyte_tmp_hnw_user_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_media_insights, tmpTable=_airbyte_tmp_jta_media_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_jta_media_insights to the source table _airbyte_raw_media_insights. 2022-07-31 22:35:56 destination > 2022-07-31 22:35:56 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_jta_media_insights}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_media_insights}} 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_media_insights! 2022-07-31 22:35:58 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:35:58 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_media_insights, tmpTable=_airbyte_tmp_jta_media_insights, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):76 - Field fails during format : 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.f.BigQueryRecordFormatter(printAndCleanFieldFails):70 - No field fails during record format. 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):79 - Closing connector:AbstractBigQueryUploader{table=_airbyte_raw_users, tmpTable=_airbyte_tmp_amp_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):96 - Uploading data from the tmp table _airbyte_tmp_amp_users to the source table _airbyte_raw_users. 2022-07-31 22:35:58 destination > 2022-07-31 22:35:58 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadDataToTableFromTmpTable):121 - Replication finished with no explicit errors. Copying data from tmp tables to permanent 2022-07-31 22:36:00 destination > 2022-07-31 22:36:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(copyTable):187 - successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_tmp_amp_users}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=instagram, tableId=_airbyte_raw_users}} 2022-07-31 22:36:00 destination > 2022-07-31 22:36:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):98 - Data is successfully loaded to the source table _airbyte_raw_users! 2022-07-31 22:36:00 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $: null found, object expected 2022-07-31 22:36:00 ERROR i.a.w.i.DefaultAirbyteStreamFactory(lambda$create$1):70 - Validation failed: null 2022-07-31 22:36:00 destination > 2022-07-31 22:36:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(uploadData):100 - Final state message is accepted. 2022-07-31 22:36:00 destination > 2022-07-31 22:36:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):112 - Removing tmp tables... 2022-07-31 22:36:00 destination > 2022-07-31 22:36:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(dropTmpTable):114 - Finishing destination process...completed 2022-07-31 22:36:00 destination > 2022-07-31 22:36:00 INFO i.a.i.d.b.u.AbstractBigQueryUploader(close):86 - Closed connector:AbstractBigQueryUploader{table=_airbyte_raw_users, tmpTable=_airbyte_tmp_amp_users, syncMode=WRITE_APPEND, writer=class io.airbyte.integrations.destination.bigquery.writer.BigQueryTableWriter, recordFormatter=class io.airbyte.integrations.destination.bigquery.formatter.DefaultBigQueryRecordFormatter} 2022-07-31 22:36:00 destination > 2022-07-31 22:36:00 INFO i.a.i.b.IntegrationRunner(runInternal):169 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-07-31 22:36:00 ERROR i.a.w.g.DefaultReplicationWorker(run):180 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:173) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:136) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:137) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:348) ~[io.airbyte-airbyte-workers-0.39.37-alpha.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-07-31 22:36:00 INFO i.a.w.g.DefaultReplicationWorker(run):239 - sync summary: io.airbyte.config.ReplicationAttemptSummary@348ac0a3[status=failed,recordsSynced=580,bytesSynced=1061023,startTime=1659306859083,endTime=1659306960895,totalStats=io.airbyte.config.SyncStats@226ddd7b[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@530887c6[streamName=media,stats=io.airbyte.config.SyncStats@15204943[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=,recordsCommitted=]]]] 2022-07-31 22:36:00 INFO i.a.w.g.DefaultReplicationWorker(run):268 - Source did not output any state messages 2022-07-31 22:36:00 WARN i.a.w.g.DefaultReplicationWorker(run):279 - State capture: No state retained. 2022-07-31 22:36:00 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:36:00 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):161 - sync summary: io.airbyte.config.StandardSyncOutput@394ddec0[standardSyncSummary=io.airbyte.config.StandardSyncSummary@7c4f478d[status=failed,recordsSynced=580,bytesSynced=1061023,startTime=1659306859083,endTime=1659306960895,totalStats=io.airbyte.config.SyncStats@226ddd7b[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=0,recordsCommitted=0],streamStats=[io.airbyte.config.StreamSyncStats@530887c6[streamName=media,stats=io.airbyte.config.SyncStats@15204943[recordsEmitted=580,bytesEmitted=1061023,stateMessagesEmitted=,recordsCommitted=]]]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@62c97581[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@4df99b93[stream=io.airbyte.protocol.models.AirbyteStream@1a95f732[name=media,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"caption":{"type":["null","string"]},"page_id":{"type":["null","string"]},"children":{"type":["null","array"],"items":{"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]}}}},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"like_count":{"type":["null","integer"]},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]},"comments_count":{"type":["null","integer"]},"is_comment_enabled":{"type":["null","boolean"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@1c60b8c2[stream=io.airbyte.protocol.models.AirbyteStream@352ca3b2[name=media_insights,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"reach":{"type":["null","integer"]},"saved":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"engagement":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"video_views":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]},"carousel_album_reach":{"type":["null","integer"]},"carousel_album_saved":{"type":["null","integer"]},"carousel_album_engagement":{"type":["null","integer"]},"carousel_album_impressions":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@34888387[stream=io.airbyte.protocol.models.AirbyteStream@191de43[name=stories,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"ig_id":{"type":["null","string"]},"owner":{"type":["null","object"],"properties":{"id":{"type":["null","string"]}}},"caption":{"type":["null","string"]},"page_id":{"type":["null","string"]},"username":{"type":["null","string"]},"media_url":{"type":["null","string"]},"permalink":{"type":["null","string"]},"shortcode":{"type":["null","string"]},"timestamp":{"type":["null","string"],"format":"date-time"},"like_count":{"type":["null","integer"]},"media_type":{"type":["null","string"]},"thumbnail_url":{"type":["null","string"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@182ec01b[stream=io.airbyte.protocol.models.AirbyteStream@484fd19f[name=story_insights,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"exits":{"type":["null","integer"]},"reach":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"replies":{"type":["null","integer"]},"taps_back":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"taps_forward":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@382be7aa[stream=io.airbyte.protocol.models.AirbyteStream@3747452a[name=user_insights,jsonSchema={"type":"object","properties":{"date":{"type":["null","string"],"format":"date-time"},"reach":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"reach_week":{"type":["null","integer"]},"impressions":{"type":["null","integer"]},"profile_views":{"type":["null","integer"]},"reach_days_28":{"type":["null","integer"]},"follower_count":{"type":["null","integer"]},"website_clicks":{"type":["null","integer"]},"impressions_week":{"type":["null","integer"]},"online_followers":{"type":["null","object"]},"phone_call_clicks":{"type":["null","integer"]},"business_account_id":{"type":["null","string"]},"impressions_days_28":{"type":["null","integer"]},"text_message_clicks":{"type":["null","integer"]},"get_directions_clicks":{"type":["null","integer"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date],sourceDefinedPrimaryKey=[],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[date],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@598775c1[stream=io.airbyte.protocol.models.AirbyteStream@6ff28447[name=user_lifetime_insights,jsonSchema={"type":"object","properties":{"date":{"type":["null","string"],"format":"date-time"},"value":{"type":["integer","object"]},"metric":{"type":["null","string"]},"page_id":{"type":["null","string"]},"business_account_id":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[],additionalProperties={}], io.airbyte.protocol.models.ConfiguredAirbyteStream@88328a4[stream=io.airbyte.protocol.models.AirbyteStream@5e0528b[name=users,jsonSchema={"type":"object","properties":{"id":{"type":["null","string"]},"name":{"type":["null","string"]},"ig_id":{"type":["null","integer"]},"page_id":{"type":["null","string"]},"website":{"type":["null","string"]},"username":{"type":["null","string"]},"biography":{"type":["null","string"]},"media_count":{"type":["null","integer"]},"follows_count":{"type":["null","integer"]},"followers_count":{"type":["null","integer"]},"profile_picture_url":{"type":["null","string"]}}},supportedSyncModes=[full_refresh],sourceDefinedCursor=,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=instagram,additionalProperties={}],syncMode=full_refresh,cursorField=[],destinationSyncMode=append,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@672b068b[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@1c007695[additionalProperties={attemptNumber=2, jobId=6838}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source process exited with non-zero exit code 1 at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:348) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more ,retryable=,timestamp=1659306936325]]] 2022-07-31 22:36:00 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating... 2022-07-31 22:36:00 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/6838/2/logs.log 2022-07-31 22:36:00 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.39.37-alpha 2022-07-31 22:36:00 INFO i.a.w.g.DefaultNormalizationWorker(run):49 - Running normalization. 2022-07-31 22:36:00 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):122 - Running with normalization version: airbyte/normalization:0.2.8 2022-07-31 22:36:01 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/normalization:0.2.8 exists... 2022-07-31 22:36:01 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/normalization:0.2.8 was found locally. 2022-07-31 22:36:01 INFO i.a.w.p.DockerProcessFactory(create):108 - Creating docker job ID: 6838 2022-07-31 22:36:01 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/6838/2/normalize --log-driver none --name normalization-normalize-6838-2-cltwc --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.39.37-alpha airbyte/normalization:0.2.8 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json 2022-07-31 22:36:01 normalization > Running: transform-config --config destination_config.json --integration-type bigquery --out /data/6838/2/normalize 2022-07-31 22:36:01 normalization > Namespace(config='destination_config.json', integration_type=, out='/data/6838/2/normalize') 2022-07-31 22:36:01 normalization > transform_bigquery 2022-07-31 22:36:01 normalization > Running: transform-catalog --integration-type bigquery --profile-config-dir /data/6838/2/normalize --catalog destination_catalog.json --out /data/6838/2/normalize/models/generated/ --json-column _airbyte_data 2022-07-31 22:36:02 normalization > Processing destination_catalog.json... 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_ab1.sql from media 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_ab2.sql from media 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_ab3.sql from media 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/media.sql from media 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_insights_ab1.sql from media_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_insights_ab2.sql from media_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_insights_ab3.sql from media_insights 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/media_insights.sql from media_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/stories_ab1.sql from stories 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/stories_ab2.sql from stories 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/stories_ab3.sql from stories 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/stories.sql from stories 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/story_insights_ab1.sql from story_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/story_insights_ab2.sql from story_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/story_insights_ab3.sql from story_insights 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/story_insights.sql from story_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/user_insights_ab1.sql from user_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/user_insights_ab2.sql from user_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/user_insights_ab3.sql from user_insights 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/user_insights.sql from user_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab1.sql from user_lifetime_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab2.sql from user_lifetime_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/user_lifetime_insights_ab3.sql from user_lifetime_insights 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/user_lifetime_insights.sql from user_lifetime_insights 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/users_ab1.sql from users 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/users_ab2.sql from users 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/users_ab3.sql from users 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/users.sql from users 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_owner_ab1.sql from media/owner 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_owner_ab2.sql from media/owner 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_owner_ab3.sql from media/owner 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/media_owner.sql from media/owner 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_children_ab1.sql from media/children 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_children_ab2.sql from media/children 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_children_ab3.sql from media/children 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/media_children.sql from media/children 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/stories_owner_ab1.sql from stories/owner 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/stories_owner_ab2.sql from stories/owner 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/stories_owner_ab3.sql from stories/owner 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/stories_owner.sql from stories/owner 2022-07-31 22:36:02 normalization > Ignoring stream 'value' from user_lifetime_insights/value because properties list is empty 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab1.sql from media/children/owner 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab2.sql from media/children/owner 2022-07-31 22:36:02 normalization > Generating airbyte_ctes/instagram/media_children_owner_ab3.sql from media/children/owner 2022-07-31 22:36:02 normalization > Generating airbyte_incremental/instagram/media_children_owner.sql from media/children/owner 2022-07-31 22:36:02 normalization > detected no config file for ssh, assuming ssh is off. 2022-07-31 22:36:05 normalization > [--event-buffer-size EVENT_BUFFER_SIZE] 2022-07-31 22:36:05 normalization > --event-buffer-size EVENT_BUFFER_SIZE 2022-07-31 22:36:05 normalization > 2022-07-31 22:36:05 normalization > DBT >=1.0.0 detected; using 10K event buffer size 2022-07-31 22:36:05 normalization > 2022-07-31 22:36:08 normalization > 22:36:08 Running with dbt=1.0.0 2022-07-31 22:36:08 normalization > 22:36:08 Partial parse save file not found. Starting full parse. 2022-07-31 22:36:10 normalization > 22:36:10 [WARNING]: Configuration paths exist in your dbt_project.yml file which do not apply to any resources. 2022-07-31 22:36:10 normalization > There are 2 unused configuration paths: 2022-07-31 22:36:10 normalization > - models.airbyte_utils.generated.airbyte_tables 2022-07-31 22:36:10 normalization > - models.airbyte_utils.generated.airbyte_views 2022-07-31 22:36:10 normalization > 2022-07-31 22:36:10 normalization > 22:36:10 Found 44 models, 0 tests, 0 snapshots, 0 analyses, 553 macros, 0 operations, 0 seed files, 7 sources, 0 exposures, 0 metrics 2022-07-31 22:36:10 normalization > 22:36:10 2022-07-31 22:36:11 normalization > 22:36:11 Concurrency: 8 threads (target='prod') 2022-07-31 22:36:11 normalization > 22:36:11 2022-07-31 22:36:12 normalization > 22:36:12 1 of 11 START incremental model instagram.media......................................................................... [RUN] 2022-07-31 22:36:12 normalization > 22:36:12 3 of 11 START incremental model instagram.stories....................................................................... [RUN] 2022-07-31 22:36:12 normalization > 22:36:12 2 of 11 START incremental model instagram.user_lifetime_insights........................................................ [RUN] 2022-07-31 22:36:12 normalization > 22:36:12 4 of 11 START incremental model instagram.users......................................................................... [RUN] 2022-07-31 22:36:12 normalization > 22:36:12 5 of 11 START incremental model instagram.story_insights................................................................ [RUN] 2022-07-31 22:36:12 normalization > 22:36:12 6 of 11 START incremental model instagram.media_insights................................................................ [RUN] 2022-07-31 22:36:12 normalization > 22:36:12 7 of 11 START incremental model instagram.user_insights................................................................. [RUN] 2022-07-31 22:36:18 normalization > 22:36:18 4 of 11 OK created incremental model instagram.users.................................................................... [MERGE (1.0 rows, 36.8 KB processed) in 5.75s] 2022-07-31 22:36:18 normalization > 22:36:18 5 of 11 OK created incremental model instagram.story_insights........................................................... [MERGE (3.0 rows, 96.6 KB processed) in 5.64s] 2022-07-31 22:36:18 normalization > 22:36:18 6 of 11 OK created incremental model instagram.media_insights........................................................... [MERGE (1.0 rows, 7.8 MB processed) in 5.79s] 2022-07-31 22:36:18 normalization > 22:36:18 2 of 11 OK created incremental model instagram.user_lifetime_insights................................................... [MERGE (4.0 rows, 147.9 KB processed) in 5.95s] 2022-07-31 22:36:18 normalization > 22:36:18 7 of 11 OK created incremental model instagram.user_insights............................................................ [MERGE (1.0 rows, 1.0 MB processed) in 5.95s] 2022-07-31 22:36:19 normalization > 22:36:19 3 of 11 OK created incremental model instagram.stories.................................................................. [MERGE (1.0 rows, 101.3 KB processed) in 6.63s] 2022-07-31 22:36:19 normalization > 22:36:19 1 of 11 OK created incremental model instagram.media.................................................................... [MERGE (582.0 rows, 10.5 MB processed) in 6.93s] 2022-07-31 22:36:19 normalization > 22:36:19 8 of 11 START incremental model instagram.stories_owner................................................................. [RUN] 2022-07-31 22:36:19 normalization > 22:36:19 9 of 11 START incremental model instagram.media_owner................................................................... [RUN] 2022-07-31 22:36:20 normalization > 22:36:20 10 of 11 START incremental model instagram.media_children............................................................... [RUN] 2022-07-31 22:36:24 normalization > 22:36:24 8 of 11 OK created incremental model instagram.stories_owner............................................................ [MERGE (1.0 rows, 141.0 Bytes processed) in 4.79s] 2022-07-31 22:36:24 normalization > 22:36:24 9 of 11 OK created incremental model instagram.media_owner.............................................................. [MERGE (582.0 rows, 80.1 KB processed) in 4.73s] 2022-07-31 22:36:24 normalization > 22:36:24 10 of 11 OK created incremental model instagram.media_children.......................................................... [MERGE (463.0 rows, 263.6 KB processed) in 4.90s] 2022-07-31 22:36:25 normalization > 22:36:25 11 of 11 START incremental model instagram.media_children_owner......................................................... [RUN] 2022-07-31 22:36:29 normalization > 22:36:29 11 of 11 OK created incremental model instagram.media_children_owner.................................................... [MERGE (469.0 rows, 64.6 KB processed) in 4.71s] 2022-07-31 22:36:29 normalization > 22:36:29 2022-07-31 22:36:29 normalization > 22:36:29 Finished running 11 incremental models in 19.09s. 2022-07-31 22:36:29 normalization > 22:36:29 2022-07-31 22:36:29 normalization > 22:36:29 Completed successfully 2022-07-31 22:36:29 normalization > 22:36:29 2022-07-31 22:36:29 normalization > 22:36:29 Done. PASS=11 WARN=0 ERROR=0 SKIP=0 TOTAL=11 2022-07-31 22:36:30 INFO i.a.w.g.DefaultNormalizationWorker(run):73 - Normalization executed in 29 seconds. 2022-07-31 22:36:30 INFO i.a.w.g.DefaultNormalizationWorker(run):79 - Normalization summary: io.airbyte.config.NormalizationSummary@2aee6cab[startTime=1659306960995,endTime=1659306990514] 2022-07-31 22:36:30 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-07-31 22:36:30 INFO i.a.w.t.TemporalUtils(withBackgroundHeartbeat):291 - Stopping temporal heartbeating...