2022-05-23 16:52:58 [32mINFO[m i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.36.6-alpha
2022-05-23 16:52:58 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/91/0/logs.log
2022-05-23 16:52:58 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.36.6-alpha
2022-05-23 16:52:58 [32mINFO[m i.a.w.DefaultReplicationWorker(run):104 - start sync worker. job id: 91 attempt id: 0
2022-05-23 16:52:58 [32mINFO[m i.a.w.DefaultReplicationWorker(run):116 - configured sync modes: {null.activities=full_refresh - overwrite, null.ads_insights_platform_and_device=incremental - append_dedup, null.ads=incremental - append_dedup, null.ad_creatives=full_refresh - overwrite, null.ads_insights=incremental - append_dedup, null.ads_insights_age_and_gender=incremental - append_dedup, null.ads_insights_country=incremental - append_dedup, null.ads_insights_dma=incremental - append_dedup, null.ads_insights_action_type=incremental - append_dedup, null.images=incremental - append_dedup, null.campaigns=incremental - append_dedup, null.ad_sets=incremental - append_dedup, null.ads_insights_region=incremental - append_dedup, null.videos=incremental - append_dedup, null.ad_account=full_refresh - overwrite}
2022-05-23 16:52:58 [32mINFO[m i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination...
2022-05-23 16:52:58 [32mINFO[m i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-redshift:0.3.34 exists...
2022-05-23 16:52:58 [32mINFO[m i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-redshift:0.3.34 was found locally.
2022-05-23 16:52:58 [32mINFO[m i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 91
2022-05-23 16:52:58 [32mINFO[m i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/91/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/destination-redshift:0.3.34 -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.36.6-alpha -e WORKER_JOB_ID=91 airbyte/destination-redshift:0.3.34 write --config destination_config.json --catalog destination_catalog.json
2022-05-23 16:52:58 [32mINFO[m i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-facebook-marketing:0.2.44 exists...
2022-05-23 16:52:58 [32mINFO[m i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-facebook-marketing:0.2.44 was found locally.
2022-05-23 16:52:58 [32mINFO[m i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 91
2022-05-23 16:52:58 [32mINFO[m i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/91/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_JOB_ATTEMPT=0 -e WORKER_CONNECTOR_IMAGE=airbyte/source-facebook-marketing:0.2.44 -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.36.6-alpha -e WORKER_JOB_ID=91 airbyte/source-facebook-marketing:0.2.44 read --config source_config.json --catalog source_catalog.json
2022-05-23 16:52:58 [32mINFO[m i.a.w.DefaultReplicationWorker(run):158 - Waiting for source and destination threads to complete.
2022-05-23 16:52:58 [32mINFO[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):279 - Replication thread started.
2022-05-23 16:52:58 [32mINFO[m i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):339 - Destination output thread started.
2022-05-23 16:52:59 [43mdestination[0m > SLF4J: Class path contains multiple SLF4J bindings.
2022-05-23 16:52:59 [43mdestination[0m > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-05-23 16:52:59 [43mdestination[0m > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-05-23 16:52:59 [43mdestination[0m > SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2022-05-23 16:52:59 [43mdestination[0m > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2022-05-23 16:52:59 [43mdestination[0m > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2022-05-23 16:52:59 [44msource[0m > Starting syncing SourceFacebookMarketing
2022-05-23 16:52:59 [44msource[0m > Syncing stream: activities 
2022-05-23 16:53:00 [43mdestination[0m > 2022-05-23 16:53:00 [32mINFO[m i.a.i.d.r.RedshiftDestination(main):70 - starting destination: class io.airbyte.integrations.destination.redshift.RedshiftDestination
2022-05-23 16:53:00 [43mdestination[0m > 2022-05-23 16:53:00 [32mINFO[m i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2022-05-23 16:53:00 [43mdestination[0m > 2022-05-23 16:53:00 [32mINFO[m i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.destination.redshift.RedshiftDestination
2022-05-23 16:53:00 [43mdestination[0m > 2022-05-23 16:53:00 [32mINFO[m i.a.i.b.IntegrationRunner(runInternal):124 - Command: WRITE
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:00 [32mINFO[m i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [33mWARN[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [33mWARN[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [33mWARN[m i.a.i.d.r.RedshiftDestination(determineUploadMode):56 - The "standard" upload mode is not performant, and is not recommended for production. Please use the Amazon S3 upload mode if you are syncing a large amount of data.
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.c.SwitchingDestination(getConsumer):65 - Using destination type: INSERT_WITH_SUPER_TMP_TYPE
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m c.z.h.HikariDataSource(<init>):80 - HikariPool-1 - Starting...
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m c.z.h.HikariDataSource(<init>):82 - HikariPool-1 - Start completed.
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=activities, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_eoz_activities, outputTableName=_airbyte_raw_activities, syncMode=overwrite}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ad_account, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_rjt_ad_account, outputTableName=_airbyte_raw_ad_account, syncMode=overwrite}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ad_creatives, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_zsl_ad_creatives, outputTableName=_airbyte_raw_ad_creatives, syncMode=overwrite}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ad_sets, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_esb_ad_sets, outputTableName=_airbyte_raw_ad_sets, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ads, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_fsf_ads, outputTableName=_airbyte_raw_ads, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ads_insights, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_ufz_ads_insights, outputTableName=_airbyte_raw_ads_insights, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ads_insights_action_type, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_psj_ads_insights_action_type, outputTableName=_airbyte_raw_ads_insights_action_type, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ads_insights_age_and_gender, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_rno_ads_insights_age_and_gender, outputTableName=_airbyte_raw_ads_insights_age_and_gender, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ads_insights_country, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_olx_ads_insights_country, outputTableName=_airbyte_raw_ads_insights_country, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ads_insights_dma, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_efu_ads_insights_dma, outputTableName=_airbyte_raw_ads_insights_dma, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ads_insights_platform_and_device, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_ota_ads_insights_platform_and_device, outputTableName=_airbyte_raw_ads_insights_platform_and_device, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=ads_insights_region, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_ppz_ads_insights_region, outputTableName=_airbyte_raw_ads_insights_region, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=campaigns, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_len_campaigns, outputTableName=_airbyte_raw_campaigns, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=images, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_hoc_images, outputTableName=_airbyte_raw_images, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):98 - Write config: WriteConfig{streamName=videos, namespace=null, outputSchemaName=airbyte, tmpTableName=_airbyte_tmp_elf_videos, outputTableName=_airbyte_raw_videos, syncMode=append_dedup}
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.b.BufferedStreamConsumer(startTracked):116 - class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):123 - Preparing tmp tables in destination started for 15 streams
2022-05-23 16:53:01 [43mdestination[0m > 2022-05-23 16:53:01 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream activities. schema: airbyte, tmp table name: _airbyte_tmp_eoz_activities
2022-05-23 16:53:02 [43mdestination[0m > 2022-05-23 16:53:02 [32mINFO[m c.z.h.p.PoolBase(getAndSetNetworkTimeout):536 - HikariPool-1 - Driver does not support get/set network timeout for connections. ([Amazon][JDBC](10220) Driver does not support this optional feature.)
2022-05-23 16:53:02 [43mdestination[0m > 2022-05-23 16:53:02 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ad_account. schema: airbyte, tmp table name: _airbyte_tmp_rjt_ad_account
2022-05-23 16:53:02 [43mdestination[0m > 2022-05-23 16:53:02 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ad_creatives. schema: airbyte, tmp table name: _airbyte_tmp_zsl_ad_creatives
2022-05-23 16:53:02 [43mdestination[0m > 2022-05-23 16:53:02 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ad_sets. schema: airbyte, tmp table name: _airbyte_tmp_esb_ad_sets
2022-05-23 16:53:02 [43mdestination[0m > 2022-05-23 16:53:02 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ads. schema: airbyte, tmp table name: _airbyte_tmp_fsf_ads
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ads_insights. schema: airbyte, tmp table name: _airbyte_tmp_ufz_ads_insights
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ads_insights_action_type. schema: airbyte, tmp table name: _airbyte_tmp_psj_ads_insights_action_type
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ads_insights_age_and_gender. schema: airbyte, tmp table name: _airbyte_tmp_rno_ads_insights_age_and_gender
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ads_insights_country. schema: airbyte, tmp table name: _airbyte_tmp_olx_ads_insights_country
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ads_insights_dma. schema: airbyte, tmp table name: _airbyte_tmp_efu_ads_insights_dma
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ads_insights_platform_and_device. schema: airbyte, tmp table name: _airbyte_tmp_ota_ads_insights_platform_and_device
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream ads_insights_region. schema: airbyte, tmp table name: _airbyte_tmp_ppz_ads_insights_region
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream campaigns. schema: airbyte, tmp table name: _airbyte_tmp_len_campaigns
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream images. schema: airbyte, tmp table name: _airbyte_tmp_hoc_images
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):127 - Preparing tmp table in destination started for stream videos. schema: airbyte, tmp table name: _airbyte_tmp_elf_videos
2022-05-23 16:53:03 [43mdestination[0m > 2022-05-23 16:53:03 [32mINFO[m i.a.i.d.j.JdbcBufferedConsumerFactory(lambda$onStartFunction$1):133 - Preparing tables in destination completed.
2022-05-23 16:54:07 [32mINFO[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 1000 (809 KB)
2022-05-23 16:54:55 [32mINFO[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 2000 (2 MB)
2022-05-23 16:55:46 [32mINFO[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 3000 (3 MB)
2022-05-23 16:56:37 [32mINFO[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 4000 (4 MB)
2022-05-23 16:57:32 [32mINFO[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 5000 (5 MB)
2022-05-23 16:58:23 [44msource[0m > Utilization is too high (91)%, pausing for 1 minute
2022-05-23 16:59:28 [44msource[0m > Utilization is too high (91)%, pausing for 1 minute
2022-05-23 17:00:33 [44msource[0m > Utilization is too high (93)%, pausing for 1 minute
2022-05-23 17:01:36 [32mINFO[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 6000 (6 MB)
2022-05-23 17:01:36 [44msource[0m > Utilization is too high (94)%, pausing for 1 minute
2022-05-23 17:02:36 [43mdestination[0m > 2022-05-23 17:02:36 [32mINFO[m i.a.i.d.r.InMemoryRecordBufferingStrategy(lambda$flushAll$1):84 - Flushing activities: 6094 records (24 MB)
2022-05-23 17:02:36 [43mdestination[0m > 2022-05-23 17:02:36 [32mINFO[m i.a.i.d.r.o.RedshiftSqlOperations(insertRecordsInternal):76 - actual size of batch: 6094
2022-05-23 17:02:42 [44msource[0m > Utilization is too high (95)%, pausing for 5 minutes