2023-06-26 09:38:04 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/2/logs.log
2023-06-26 09:38:04 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:38:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:38:04 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:38:04 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-06-26 09:38:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:38:04 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:38:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:38:04 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:38:05 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-mysql:2.0.25 exists...
2023-06-26 09:38:05 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-mysql:2.0.25 was found locally.
2023-06-26 09:38:05 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = source-mysql-check-33-2-epvdk with resources io.airbyte.config.ResourceRequirements@5fe08e52[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@1f5cfdba[hosts=[prod-read-replica.cpwmy4x3jsiq.ap-south-1.rds.amazonaws.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}]
2023-06-26 09:38:05 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/2 --log-driver none --name source-mysql-check-33-2-epvdk --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-mysql:2.0.25 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/source-mysql:2.0.25 check --config source_config.json
2023-06-26 09:38:05 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:38:05 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.s.m.MySqlSource(main):452 starting source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json}
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):106 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):107 Command: CHECK
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2023-06-26 09:38:06 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:06 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.z.h.HikariDataSource(<init>):80 HikariPool-1 - Starting...
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.z.h.HikariDataSource(<init>):82 HikariPool-1 - Start completed.
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):138 Attempting to get metadata from the database to see if we can connect.
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated...
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed.
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):195 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:38:06 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.s.m.MySqlSource(main):454 completed source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:38:07 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@4de18d72[status=succeeded,message=<null>,additionalProperties={}]
2023-06-26 09:38:07 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:38:07 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:07 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-06-26 09:38:07 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:07 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/2/logs.log
2023-06-26 09:38:07 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:38:07 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:38:07 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:38:07 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-06-26 09:38:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:38:07 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:38:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:38:07 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:38:07 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-bigquery:1.4.4 exists...
2023-06-26 09:38:07 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-bigquery:1.4.4 was found locally.
2023-06-26 09:38:07 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = destination-bigquery-check-33-2-cjzce with resources io.airbyte.config.ResourceRequirements@9d4f870[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-06-26 09:38:07 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/2 --log-driver none --name destination-bigquery-check-33-2-cjzce --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.4.4 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/destination-bigquery:1.4.4 check --config source_config.json
2023-06-26 09:38:07 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:38:08 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json}
2023-06-26 09:38:08 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:38:08 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: CHECK
2023-06-26 09:38:08 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2023-06-26 09:38:08 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:08 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:08 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:08 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):419 Selected loading method is set to: GCS
2023-06-26 09:38:12 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 S3 format config: {"format_type":"CSV","flattening":"No flattening"}
2023-06-26 09:38:13 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3BaseChecks(testSingleUpload):40 Started testing if all required credentials assigned to user for single file uploading
2023-06-26 09:38:15 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3BaseChecks(testSingleUpload):48 Finished checking for normal upload mode
2023-06-26 09:38:15 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3BaseChecks(testMultipartUpload):52 Started testing if all required credentials assigned to user for multipart upload
2023-06-26 09:38:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/test_1687772295203 with full ID ABPnzm7sadM847EqdCF34VD8HNIOLG46UvNUsK32wdrNHf2aVLwPXozSKQbj3m_Pe7lMAhA
2023-06-26 09:38:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-06-26 09:38:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-06-26 09:38:16 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN a.m.s.MultiPartOutputStream(close):160 [MultipartOutputStream for parts 1 - 10000] is already closed
2023-06-26 09:38:16 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.StreamTransferManager(complete):367 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/test_1687772295203 with id ABPnzm7sa..._Pe7lMAhA]: Uploading leftover stream [Part number 1 containing 3.34 MB]
2023-06-26 09:38:18 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/test_1687772295203 with id ABPnzm7sa..._Pe7lMAhA]: Finished uploading [Part number 1 containing 3.34 MB]
2023-06-26 09:38:18 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.StreamTransferManager(complete):395 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/test_1687772295203 with id ABPnzm7sa..._Pe7lMAhA]: Completed
2023-06-26 09:38:19 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3BaseChecks(testMultipartUpload):74 Finished verification for multipart upload mode
2023-06-26 09:38:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:38:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Destination process done (exit code 0)
2023-06-26 09:38:21 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@63efc255[status=succeeded,message=<null>,additionalProperties={}]
2023-06-26 09:38:21 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get state
2023-06-26 09:38:21 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true, Normalization Supported: false, Feature Flag Enabled: false
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to set attempt sync config
2023-06-26 09:38:21 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto
2023-06-26 09:38:21 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/2/logs.log
2023-06-26 09:38:21 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get the source definition for feature flag checks
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get the source definition
2023-06-26 09:38:21 INFO i.a.w.g.ReplicationWorkerFactory(create):125 - Setting up source...
2023-06-26 09:38:21 INFO i.a.w.g.ReplicationWorkerFactory(create):132 - Setting up destination...
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable METRIC_CLIENT: ''
2023-06-26 09:38:21 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 
2023-06-26 09:38:21 INFO i.a.w.g.ReplicationWorkerFactory(create):144 - Setting up replication worker...
2023-06-26 09:38:21 INFO i.a.w.g.DefaultReplicationWorker(run):126 - start sync worker. job id: 33 attempt id: 2
2023-06-26 09:38:21 INFO i.a.w.g.DefaultReplicationWorker(run):131 - configured sync modes: {medisage2.newsletters=incremental - append_dedup}
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:21 INFO i.a.w.g.DefaultReplicationWorker(run):143 - Committing states from replication activity
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION -----
2023-06-26 09:38:21 INFO i.a.w.g.DefaultReplicationWorker(run):145 - Committing stats from replication activity
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:21 INFO i.a.w.i.DefaultAirbyteDestination(start):88 - Running destination...
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-bigquery:1.4.4 exists...
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-bigquery:1.4.4 was found locally.
2023-06-26 09:38:21 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = destination-bigquery-write-33-2-xriqy with resources io.airbyte.config.ResourceRequirements@3a25098c[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-06-26 09:38:21 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/2 --log-driver none --name destination-bigquery-write-33-2-xriqy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.4.4 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/destination-bigquery:1.4.4 write --config destination_config.json --catalog destination_catalog.json
2023-06-26 09:38:21 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0
2023-06-26 09:38:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:38:21 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-mysql:2.0.25 exists...
2023-06-26 09:38:21 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-mysql:2.0.25 was found locally.
2023-06-26 09:38:21 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = source-mysql-read-33-2-efqux with resources io.airbyte.config.ResourceRequirements@27c7bb74[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@2234da33[hosts=[prod-read-replica.cpwmy4x3jsiq.ap-south-1.rds.amazonaws.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}]
2023-06-26 09:38:21 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/2 --log-driver none --name source-mysql-read-33-2-efqux --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-mysql:2.0.25 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=2 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/source-mysql:2.0.25 read --config source_config.json --catalog source_catalog.json --state input_state.json
2023-06-26 09:38:21 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:38:21 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes.
2023-06-26 09:38:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):228 - Destination output thread started.
2023-06-26 09:38:21 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):272 - Replication thread started.
2023-06-26 09:38:22 source > INFO i.a.i.s.m.MySqlSource(main):452 starting source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:38:22 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json}
2023-06-26 09:38:22 source > INFO i.a.i.b.IntegrationRunner(runInternal):106 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:38:22 source > INFO i.a.i.b.IntegrationRunner(runInternal):107 Command: READ
2023-06-26 09:38:22 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'}
2023-06-26 09:38:22 destination > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2023-06-26 09:38:22 destination > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:38:22 destination > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: WRITE
2023-06-26 09:38:22 destination > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2023-06-26 09:38:22 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:22 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:23 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:23 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:23 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:38:23 destination > INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):419 Selected loading method is set to: GCS
2023-06-26 09:38:23 destination > INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 S3 format config: {"format_type":"AVRO","flattening":"No flattening"}
2023-06-26 09:38:23 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL
2023-06-26 09:38:23 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM.
2023-06-26 09:38:23 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):169 Found matching cursor in state. Stream: medisage2_newsletters. Cursor Field: id Value: 578 Count: 1
2023-06-26 09:38:23 destination > INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):435 All tmp files will be removed from GCS when replication is finished
2023-06-26 09:38:23 source > INFO c.z.h.HikariDataSource(<init>):80 HikariPool-1 - Starting...
2023-06-26 09:38:23 source > INFO c.z.h.HikariDataSource(<init>):82 HikariPool-1 - Start completed.
2023-06-26 09:38:23 destination > INFO i.a.i.d.b.BigQueryDestination(getGcsRecordConsumer):325 Creating BigQuery staging message consumer with staging ID aaf83f25-d0ea-4eaf-9306-c1e2d7466f82 at 2023-06-26T09:38:23.216Z
2023-06-26 09:38:23 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):92 BigQuery write config: BigQueryWriteConfig[streamName=newsletters, namespace=null, datasetId=medisage_airbyte_dataset, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_tmp_npi_newsletters}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2023-06-26 09:38:23 destination > INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):144 class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2023-06-26 09:38:23 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):115 Preparing airbyte_raw tables in destination started for 1 streams
2023-06-26 09:38:23 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):117 Preparing staging are in destination for schema: Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, stream: newsletters, target table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}, stage: newsletters
2023-06-26 09:38:23 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createSchemaIfNotExists):86 Creating dataset medisage_airbyte_dataset
2023-06-26 09:38:23 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):450 Data source product recognized as MySQL:5.7.38-log
2023-06-26 09:38:23 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):166 Internal schemas to exclude: [information_schema, performance_schema, mysql, sys]
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"NO","COLUMN_KEY":"PRI","EXTRA":"auto_increment"}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"title","COLUMN_TYPE":"varchar(200)","IS_NULLABLE":"NO","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"partner_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"NO","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"image_name","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"preview","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"file_name","COLUMN_TYPE":"varchar(200)","IS_NULLABLE":"NO","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"description","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"is_active","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"1","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"ip_address","COLUMN_TYPE":"varchar(45)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"deleted_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"updated_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"partner_division_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"knowledge_category_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"view_count","COLUMN_TYPE":"int(11)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"last_seen_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"part_of_video","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"1","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"video_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"month_added","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_show","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_schedule","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_timestamp","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"send_to_email","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"email_file","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"is_open_newsletter","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"html_content","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"json_data","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_title","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_description","COLUMN_TYPE":"text","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_keywords","COLUMN_TYPE":"text","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"expiry_date","COLUMN_TYPE":"date","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"reference_no","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_by","COLUMN_TYPE":"int(11)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_from","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"country","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"tags","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"translation","COLUMN_TYPE":"json","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"url_link","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"UNI","EXTRA":""}, medisage2, newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(getIncrementalIterators):309 using CDC: false
2023-06-26 09:38:24 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableIncremental):320 Queueing query for table: newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.j.AbstractJdbcSource(lambda$queryTableIncremental$18):327 Preparing query for table: newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.j.AbstractJdbcSource(lambda$queryTableIncremental$18):337 Table newsletters cursor count: expected 1, actual 1
2023-06-26 09:38:24 source > INFO i.a.i.s.j.AbstractJdbcSource(lambda$queryTableIncremental$18):358 Executing query for table newsletters: HikariProxyPreparedStatement@990442552 wrapping com.mysql.cj.jdbc.ServerPreparedStatement[2]: SELECT `id`,`title`,`partner_id`,`image_name`,`preview`,`file_name`,`description`,`is_active`,`ip_address`,`deleted_at`,`created_at`,`updated_at`,`partner_division_id`,`knowledge_category_id`,`view_count`,`last_seen_at`,`part_of_video`,`video_id`,`month_added`,`newsletter_show`,`newsletter_schedule`,`newsletter_timestamp`,`send_to_email`,`email_file`,`is_open_newsletter`,`html_content`,`json_data`,`meta_title`,`meta_description`,`meta_keywords`,`expiry_date`,`reference_no`,`created_by`,`created_from`,`country`,`tags`,`translation`,`url_link` FROM `medisage2`.`newsletters` WHERE `id` > ** NOT SPECIFIED ** ORDER BY `id` ASC
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlStreamingQueryConfig(initialize):26 Set initial fetch size: -2147483648 rows
2023-06-26 09:38:24 source > INFO i.a.i.s.r.StateDecoratingIterator(createStateMessage):207 State report for stream medisage2_newsletters - original: id = 578 (count 1) -> latest: id = 578 (count 1)
2023-06-26 09:38:24 source > INFO i.a.c.u.CompositeIterator(lambda$emitStartStreamStatus$1):155 STARTING -> medisage2_newsletters
2023-06-26 09:38:24 source > INFO i.a.c.u.CompositeIterator(lambda$emitRunningStreamStatus$0):148 RUNNING -> medisage2_newsletters
2023-06-26 09:38:24 source > INFO i.a.c.u.CompositeIterator(lambda$emitCompleteStreamStatus$2):162 COMPLETE -> medisage2_newsletters
2023-06-26 09:38:24 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):173 Closing database connection pool.
2023-06-26 09:38:24 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated...
2023-06-26 09:38:24 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed.
2023-06-26 09:38:24 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):175 Closed database connection pool.
2023-06-26 09:38:24 source > INFO i.a.i.b.IntegrationRunner(runInternal):195 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:38:24 source > INFO i.a.i.s.m.MySqlSource(main):454 completed source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:38:24 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):299 - Source has no more messages, closing connection.
2023-06-26 09:38:24 INFO i.a.w.g.ReplicationWorkerHelper(endOfSource):157 - Total records read: 4 (0 bytes)
2023-06-26 09:38:24 INFO i.a.w.i.FieldSelector(reportMetrics):122 - Schema validation was performed to a max of 10 records with errors per stream.
2023-06-26 09:38:24 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true
2023-06-26 09:38:24 INFO i.a.w.g.DefaultReplicationWorker(replicate):201 - Waiting for source and destination threads to complete.
2023-06-26 09:38:24 INFO i.a.w.g.DefaultReplicationWorker(replicate):206 - One of source or destination thread complete. Waiting on the other.
2023-06-26 09:38:25 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createTableIfNotExists):102 Creating target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}
2023-06-26 09:38:25 destination > INFO i.a.i.d.b.BigQueryUtils(createPartitionedTableIfNotExists):224 Partitioned table ALREADY EXISTS: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}
2023-06-26 09:38:25 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):109 Creating staging path for stream newsletters (dataset medisage_airbyte_dataset): medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/aaf83f25-d0ea-4eaf-9306-c1e2d7466f82/
2023-06-26 09:38:26 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):130 Preparing airbyte_raw tables in destination completed.
2023-06-26 09:38:26 destination > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded.
2023-06-26 09:38:26 destination > INFO i.a.i.d.b.BufferedStreamConsumer(close):255 executing on success close procedure.
2023-06-26 09:38:26 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAllBuffers):133 Flushing all 0 current buffers (0 bytes in total)
2023-06-26 09:38:26 INFO i.a.w.g.ReplicationWorkerHelper(processMessageFromDestination):234 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@6fb3698f[type=STATE,log=<null>,spec=<null>,connectionStatus=<null>,catalog=<null>,record=<null>,state=io.airbyte.protocol.models.AirbyteStateMessage@61749a09[type=STREAM,stream=io.airbyte.protocol.models.AirbyteStreamState@654b02ff[streamDescriptor=io.airbyte.protocol.models.StreamDescriptor@20499032[name=newsletters,namespace=medisage2,additionalProperties={}],streamState={"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"578","cursor_record_count":1},additionalProperties={}],global=<null>,data={"cdc":false,"streams":[{"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"578","cursor_record_count":1}]},additionalProperties={}],trace=<null>,control=<null>,additionalProperties={}]
2023-06-26 09:38:26 INFO i.a.w.h.AirbyteMessageDataExtractor(getStreamFromMessage):42 - Extracting stream from state message: io.airbyte.protocol.models.AirbyteStreamState@654b02ff[streamDescriptor=io.airbyte.protocol.models.StreamDescriptor@20499032[name=newsletters,namespace=medisage2,additionalProperties={}],streamState={"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"578","cursor_record_count":1},additionalProperties={}]
2023-06-26 09:38:26 INFO i.a.w.i.s.SyncPersistenceImpl(startBackgroundFlushStateTask):180 - starting state flush thread for connectionId 6400aad5-e2da-4d49-ad1c-42ec1179710d
2023-06-26 09:38:26 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):190 Cleaning up destination started for 1 streams
2023-06-26 09:38:26 destination > INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):186 Cleaning up staging path for stream newsletters (dataset medisage_airbyte_dataset): medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters
2023-06-26 09:38:26 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):194 Cleaning up destination completed.
2023-06-26 09:38:26 destination > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:38:26 destination > Destination process done (exit code 0)
2023-06-26 09:38:26 destination > Skipping in-connector normalization
2023-06-26 09:38:26 INFO i.a.w.g.DefaultReplicationWorker(replicate):208 - Source and destination threads complete.
2023-06-26 09:38:26 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:38:26 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):158 - sync summary: io.airbyte.config.StandardSyncOutput@212d92e3[standardSyncSummary=io.airbyte.config.StandardSyncSummary@43ba692b[status=completed,recordsSynced=0,bytesSynced=0,startTime=1687772301595,endTime=1687772306647,totalStats=io.airbyte.config.SyncStats@6cdb3af4[bytesCommitted=0,bytesEmitted=0,destinationStateMessagesEmitted=1,destinationWriteEndTime=1687772306646,destinationWriteStartTime=1687772301596,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=2,meanSecondsBetweenStateMessageEmittedandCommitted=2,recordsEmitted=0,recordsCommitted=0,replicationEndTime=1687772306647,replicationStartTime=1687772301595,sourceReadEndTime=1687772304550,sourceReadStartTime=1687772301629,sourceStateMessagesEmitted=1,additionalProperties={}],streamStats=[],additionalProperties={}],normalizationSummary=<null>,webhookOperationSummary=<null>,state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@7186bbee[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@3c7195b7[stream=io.airbyte.protocol.models.AirbyteStream@2c124023[name=newsletters,jsonSchema={"type":"object","properties":{"preview":{"type":"string"},"country":{"type":"string"},"newsletter_timestamp":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"newsletter_show":{"type":"boolean"},"created_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"description":{"type":"string"},"title":{"type":"string"},"meta_keywords":{"type":"string"},"json_data":{"type":"string"},"part_of_video":{"type":"boolean"},"image_name":{"type":"string"},"html_content":{"type":"string"},"partner_id":{"airbyte_type":"integer","type":"number"},"month_added":{"type":"string"},"updated_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"partner_division_id":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"url_link":{"type":"string"},"is_active":{"type":"boolean"},"meta_title":{"type":"string"},"file_name":{"type":"string"},"expiry_date":{"format":"date","type":"string"},"send_to_email":{"type":"boolean"},"ip_address":{"type":"string"},"email_file":{"type":"string"},"knowledge_category_id":{"airbyte_type":"integer","type":"number"},"created_by":{"airbyte_type":"integer","type":"number"},"deleted_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"tags":{"type":"string"},"meta_description":{"type":"string"},"is_open_newsletter":{"type":"boolean"},"newsletter_schedule":{"type":"boolean"},"translation":{"type":"string"},"last_seen_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"view_count":{"airbyte_type":"integer","type":"number"},"created_from":{"type":"string"},"reference_no":{"type":"string"},"video_id":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=incremental,cursorField=[id],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}]
2023-06-26 09:38:26 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):163 - Sync summary length: 3332
2023-06-26 09:38:26 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-06-26 09:38:26 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):128 - Using protocol v0
2023-06-26 09:38:26 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):148 - Using normalization: airbyte/normalization:0.4.3
2023-06-26 09:38:26 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/2/logs.log
2023-06-26 09:38:26 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:38:26 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:38:26 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:26 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION -----
2023-06-26 09:38:26 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):130 - Running with normalization version: airbyte/normalization:0.4.3
2023-06-26 09:38:26 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:26 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization:0.4.3 exists...
2023-06-26 09:38:26 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization:0.4.3 was found locally.
2023-06-26 09:38:26 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = normalization-normalize-33-2-aycmw with resources io.airbyte.config.ResourceRequirements@6f2ce324[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-06-26 09:38:26 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/2/normalize --log-driver none --name normalization-normalize-33-2-aycmw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.50.4 airbyte/normalization:0.4.3 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json
2023-06-26 09:38:26 normalization > [FATAL tini (7)] exec /airbyte/entrypoint.sh failed: Exec format error
2023-06-26 09:38:26 INFO i.a.w.n.DefaultNormalizationRunner(close):196 - Terminating normalization process...
2023-06-26 09:38:26 ERROR i.a.w.g.DefaultNormalizationWorker(run):86 - Normalization failed for job 33.
io.airbyte.workers.exception.WorkerException: Normalization process did not terminate normally (exit code: 1)
	at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:207) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:84) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-06-26 09:38:26 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 0 seconds for job 33.
2023-06-26 09:38:26 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally...
io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:106) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-06-26 09:38:26 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:38:26 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-06-26 09:38:26 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=e9830a49-4f80-3928-bd2c-f49f0bf31b0a, activityType=Normalize, attempt=1
java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:119) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
	at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?]
	at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	... 14 more
Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	... 14 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:106) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	... 1 more
2023-06-26 09:38:27 ERROR i.a.p.j.JobNotifier(notifyJob):138 - Unable to read configuration for notification. Non-blocking. Error:
java.lang.NullPointerException: Cannot invoke "io.airbyte.config.NotificationSettings.getSendOnFailure()" because "notificationSettings" is null
	at io.airbyte.persistence.job.JobNotifier.notifyJob(JobNotifier.java:109) ~[io.airbyte.airbyte-persistence-job-persistence-0.50.4.jar:?]
	at io.airbyte.persistence.job.JobNotifier.notifyJob(JobNotifier.java:76) ~[io.airbyte.airbyte-persistence-job-persistence-0.50.4.jar:?]
	at io.airbyte.persistence.job.JobNotifier.failJob(JobNotifier.java:208) ~[io.airbyte.airbyte-persistence-job-persistence-0.50.4.jar:?]
	at io.airbyte.workers.temporal.scheduling.activities.JobCreationAndStatusUpdateActivityImpl.jobFailure(JobCreationAndStatusUpdateActivityImpl.java:304) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
	at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-06-26 09:38:27 INFO i.a.v.j.JsonSchemaValidator(test):121 - JSON schema validation failed. 
errors: $.method: must be a constant value Standard
2023-06-26 09:38:27 INFO i.a.v.j.JsonSchemaValidator(test):121 - JSON schema validation failed. 
errors: $.credential.hmac_key_secret: object found, string expected, $.credential.hmac_key_access_id: object found, string expected
2023-06-26 09:38:27 INFO i.a.c.f.EnvVariableFeatureFlags(autoDisablesFailingConnections):33 - Auto Disable Failing Connections: false
2023-06-26 09:37:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get state
2023-06-26 09:37:19 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true, Normalization Supported: false, Feature Flag Enabled: false
2023-06-26 09:37:19 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to set attempt sync config
2023-06-26 09:37:19 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto
2023-06-26 09:37:20 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/0/logs.log
2023-06-26 09:37:20 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:37:20 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:37:20 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get the source definition for feature flag checks
2023-06-26 09:37:20 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get the source definition
2023-06-26 09:37:20 INFO i.a.w.g.ReplicationWorkerFactory(create):125 - Setting up source...
2023-06-26 09:37:20 INFO i.a.w.g.ReplicationWorkerFactory(create):132 - Setting up destination...
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable METRIC_CLIENT: ''
2023-06-26 09:37:20 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 
2023-06-26 09:37:20 INFO i.a.w.g.ReplicationWorkerFactory(create):144 - Setting up replication worker...
2023-06-26 09:37:20 INFO i.a.w.g.DefaultReplicationWorker(run):126 - start sync worker. job id: 33 attempt id: 0
2023-06-26 09:37:20 INFO i.a.w.g.DefaultReplicationWorker(run):131 - configured sync modes: {medisage2.newsletters=incremental - append_dedup}
2023-06-26 09:37:20 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:20 INFO i.a.w.g.DefaultReplicationWorker(run):143 - Committing states from replication activity
2023-06-26 09:37:20 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION -----
2023-06-26 09:37:20 INFO i.a.w.g.DefaultReplicationWorker(run):145 - Committing stats from replication activity
2023-06-26 09:37:20 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:20 INFO i.a.w.i.DefaultAirbyteDestination(start):88 - Running destination...
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:37:20 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-bigquery:1.4.4 exists...
2023-06-26 09:37:20 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-bigquery:1.4.4 was found locally.
2023-06-26 09:37:20 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = destination-bigquery-write-33-0-cpziy with resources io.airbyte.config.ResourceRequirements@3385079c[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-06-26 09:37:20 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/0 --log-driver none --name destination-bigquery-write-33-0-cpziy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.4.4 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/destination-bigquery:1.4.4 write --config destination_config.json --catalog destination_catalog.json
2023-06-26 09:37:20 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0
2023-06-26 09:37:20 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:20 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:37:20 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-mysql:2.0.25 exists...
2023-06-26 09:37:20 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-mysql:2.0.25 was found locally.
2023-06-26 09:37:20 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = source-mysql-read-33-0-barmb with resources io.airbyte.config.ResourceRequirements@3e3c539[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@651dac49[hosts=[prod-read-replica.cpwmy4x3jsiq.ap-south-1.rds.amazonaws.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}]
2023-06-26 09:37:20 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/0 --log-driver none --name source-mysql-read-33-0-barmb --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-mysql:2.0.25 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/source-mysql:2.0.25 read --config source_config.json --catalog source_catalog.json
2023-06-26 09:37:20 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:37:20 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes.
2023-06-26 09:37:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):228 - Destination output thread started.
2023-06-26 09:37:20 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):272 - Replication thread started.
2023-06-26 09:37:21 source > INFO i.a.i.s.m.MySqlSource(main):452 starting source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:37:21 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, config=source_config.json}
2023-06-26 09:37:21 source > INFO i.a.i.b.IntegrationRunner(runInternal):106 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:37:21 source > INFO i.a.i.b.IntegrationRunner(runInternal):107 Command: READ
2023-06-26 09:37:21 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'}
2023-06-26 09:37:21 destination > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2023-06-26 09:37:21 destination > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:37:21 destination > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: WRITE
2023-06-26 09:37:21 destination > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2023-06-26 09:37:21 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:21 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:21 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:21 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:21 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:21 destination > INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):419 Selected loading method is set to: GCS
2023-06-26 09:37:21 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL
2023-06-26 09:37:21 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM.
2023-06-26 09:37:21 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):182 No cursor field set in catalog but not present in state. Stream: medisage2_newsletters, New Cursor Field: id. Resetting cursor value
2023-06-26 09:37:21 destination > INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 S3 format config: {"format_type":"AVRO","flattening":"No flattening"}
2023-06-26 09:37:21 source > INFO c.z.h.HikariDataSource(<init>):80 HikariPool-1 - Starting...
2023-06-26 09:37:21 destination > INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):435 All tmp files will be removed from GCS when replication is finished
2023-06-26 09:37:21 source > INFO c.z.h.HikariDataSource(<init>):82 HikariPool-1 - Start completed.
2023-06-26 09:37:22 destination > INFO i.a.i.d.b.BigQueryDestination(getGcsRecordConsumer):325 Creating BigQuery staging message consumer with staging ID b0a39bc7-71fb-4785-9759-dc23bef65968 at 2023-06-26T09:37:21.823Z
2023-06-26 09:37:22 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):450 Data source product recognized as MySQL:5.7.38-log
2023-06-26 09:37:22 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):166 Internal schemas to exclude: [performance_schema, information_schema, mysql, sys]
2023-06-26 09:37:22 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):92 BigQuery write config: BigQueryWriteConfig[streamName=newsletters, namespace=null, datasetId=medisage_airbyte_dataset, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_tmp_rbl_newsletters}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2023-06-26 09:37:22 destination > INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):144 class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2023-06-26 09:37:22 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):115 Preparing airbyte_raw tables in destination started for 1 streams
2023-06-26 09:37:22 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):117 Preparing staging are in destination for schema: Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, stream: newsletters, target table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}, stage: newsletters
2023-06-26 09:37:22 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createSchemaIfNotExists):86 Creating dataset medisage_airbyte_dataset
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"NO","COLUMN_KEY":"PRI","EXTRA":"auto_increment"}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"title","COLUMN_TYPE":"varchar(200)","IS_NULLABLE":"NO","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"partner_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"NO","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"image_name","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"preview","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"file_name","COLUMN_TYPE":"varchar(200)","IS_NULLABLE":"NO","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"description","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"is_active","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"1","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"ip_address","COLUMN_TYPE":"varchar(45)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"deleted_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"updated_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"partner_division_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"knowledge_category_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"view_count","COLUMN_TYPE":"int(11)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"last_seen_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"part_of_video","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"1","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"video_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"month_added","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_show","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_schedule","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_timestamp","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"send_to_email","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"email_file","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"is_open_newsletter","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"html_content","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"json_data","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_title","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_description","COLUMN_TYPE":"text","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_keywords","COLUMN_TYPE":"text","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"expiry_date","COLUMN_TYPE":"date","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"reference_no","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_by","COLUMN_TYPE":"int(11)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_from","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"country","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"tags","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"translation","COLUMN_TYPE":"json","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"url_link","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"UNI","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlSource(getIncrementalIterators):309 using CDC: false
2023-06-26 09:37:22 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableFullRefresh):112 Queueing query for table: newsletters
2023-06-26 09:37:22 source > INFO i.a.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):73 Queueing query: SELECT `id`,`title`,`partner_id`,`image_name`,`preview`,`file_name`,`description`,`is_active`,`ip_address`,`deleted_at`,`created_at`,`updated_at`,`partner_division_id`,`knowledge_category_id`,`view_count`,`last_seen_at`,`part_of_video`,`video_id`,`month_added`,`newsletter_show`,`newsletter_schedule`,`newsletter_timestamp`,`send_to_email`,`email_file`,`is_open_newsletter`,`html_content`,`json_data`,`meta_title`,`meta_description`,`meta_keywords`,`expiry_date`,`reference_no`,`created_by`,`created_from`,`country`,`tags`,`translation`,`url_link` FROM `medisage2`.`newsletters` ORDER BY `id` ASC
2023-06-26 09:37:22 source > INFO i.a.i.s.m.MySqlStreamingQueryConfig(initialize):26 Set initial fetch size: -2147483648 rows
2023-06-26 09:37:22 source > INFO i.a.c.u.CompositeIterator(lambda$emitStartStreamStatus$1):155 STARTING -> medisage2_newsletters
2023-06-26 09:37:22 source > INFO i.a.c.u.CompositeIterator(lambda$emitRunningStreamStatus$0):148 RUNNING -> medisage2_newsletters
2023-06-26 09:37:22 source > INFO i.a.d.j.s.AdaptiveStreamingQueryConfig(accept):40 Set new fetch size: 7194 rows
2023-06-26 09:37:22 source > INFO i.a.d.j.s.TwoStageSizeEstimator(getTargetBufferByteSize):71 Max memory limit: 12331253760, JDBC buffer size: 7398752256
2023-06-26 09:37:23 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createTableIfNotExists):102 Creating target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}
2023-06-26 09:37:24 destination > INFO i.a.i.d.b.BigQueryUtils(createPartitionedTableIfNotExists):224 Partitioned table ALREADY EXISTS: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}
2023-06-26 09:37:24 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):109 Creating staging path for stream newsletters (dataset medisage_airbyte_dataset): medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/
2023-06-26 09:37:24 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):130 Preparing airbyte_raw tables in destination completed.
2023-06-26 09:37:24 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$getOrCreateBuffer$0):109 Starting a new buffer for stream newsletters (current state: 0 bytes in 0 buffers)
2023-06-26 09:37:24 destination > INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 Default schema.
2023-06-26 09:37:24 source > INFO i.a.i.s.r.StateDecoratingIterator(createStateMessage):207 State report for stream medisage2_newsletters - original: null = null (count 0) -> latest: id = 99 (count 1)
2023-06-26 09:37:25 source > INFO i.a.i.s.r.StateDecoratingIterator(createStateMessage):207 State report for stream medisage2_newsletters - original: null = null (count 0) -> latest: id = 199 (count 1)
2023-06-26 09:37:25 source > INFO i.a.i.s.r.StateDecoratingIterator(createStateMessage):207 State report for stream medisage2_newsletters - original: null = null (count 0) -> latest: id = 301 (count 1)
2023-06-26 09:37:25 source > INFO i.a.i.s.r.StateDecoratingIterator(createStateMessage):207 State report for stream medisage2_newsletters - original: null = null (count 0) -> latest: id = 401 (count 1)
2023-06-26 09:37:25 source > INFO i.a.i.s.r.StateDecoratingIterator(createStateMessage):207 State report for stream medisage2_newsletters - original: null = null (count 0) -> latest: id = 501 (count 1)
2023-06-26 09:37:25 source > INFO i.a.c.u.CompositeIterator(lambda$emitCompleteStreamStatus$2):162 COMPLETE -> medisage2_newsletters
2023-06-26 09:37:25 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):173 Closing database connection pool.
2023-06-26 09:37:25 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated...
2023-06-26 09:37:25 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed.
2023-06-26 09:37:25 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):175 Closed database connection pool.
2023-06-26 09:37:25 source > INFO i.a.i.b.IntegrationRunner(runInternal):195 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:37:25 source > INFO i.a.i.s.m.MySqlSource(main):454 completed source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:37:25 INFO i.a.w.g.ReplicationWorkerHelper(endOfSource):157 - Total records read: 579 (4 MB)
2023-06-26 09:37:25 INFO i.a.w.i.FieldSelector(reportMetrics):122 - Schema validation was performed to a max of 10 records with errors per stream.
2023-06-26 09:37:25 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true
2023-06-26 09:37:25 INFO i.a.w.g.DefaultReplicationWorker(replicate):201 - Waiting for source and destination threads to complete.
2023-06-26 09:37:25 INFO i.a.w.g.DefaultReplicationWorker(replicate):206 - One of source or destination thread complete. Waiting on the other.
2023-06-26 09:37:25 destination > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded.
2023-06-26 09:37:25 destination > INFO i.a.i.d.b.BufferedStreamConsumer(close):255 executing on success close procedure.
2023-06-26 09:37:25 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAllBuffers):133 Flushing all 1 current buffers (4 MB in total)
2023-06-26 09:37:25 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAllBuffers):137 Flushing buffer of stream newsletters (4 MB)
2023-06-26 09:37:25 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):147 Flushing buffer for stream newsletters (4 MB) to staging
2023-06-26 09:37:25 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 Finished writing data to 066d0d8b-f108-4a18-892f-5776104577b02902240498800819591.avro (4 MB)
2023-06-26 09:37:25 destination > INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):116 Uploading records to staging for stream newsletters (dataset medisage_airbyte_dataset): medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/
2023-06-26 09:37:26 destination > INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro with full ID ABPnzm4FsjdEVLTaPCRYvy-uR8R1x0qVHDB-ed0Vd8ZLTzhGdDvoJmwFj5l-b_3OmZv22YM
2023-06-26 09:37:26 destination > INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-06-26 09:37:26 destination > INFO a.m.s.StreamTransferManager(complete):367 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro with id ABPnzm4Fs...3OmZv22YM]: Uploading leftover stream [Part number 1 containing 4.72 MB]
2023-06-26 09:37:28 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro with id ABPnzm4Fs...3OmZv22YM]: Finished uploading [Part number 1 containing 4.72 MB]
2023-06-26 09:37:29 destination > INFO a.m.s.StreamTransferManager(complete):395 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro with id ABPnzm4Fs...3OmZv22YM]: Completed
2023-06-26 09:37:29 destination > INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):214 Uploaded buffer file to storage: 066d0d8b-f108-4a18-892f-5776104577b02902240498800819591.avro -> medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro (filename: 0.avro)
2023-06-26 09:37:29 destination > INFO i.a.i.d.s.S3StorageOperations(uploadRecordsToBucket):131 Successfully loaded records to stage medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/ with 0 re-attempt(s)
2023-06-26 09:37:29 destination > INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):61 Added staged file: 0.avro
2023-06-26 09:37:29 destination > INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTableFromStage):133 Uploading records from staging files to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}} (dataset medisage_airbyte_dataset): [0.avro]
2023-06-26 09:37:29 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):138 Uploading staged file: gs://medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro
2023-06-26 09:37:30 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):147 [JobId{project=data-analytics-386808, job=ca0b2efc-ae85-45d3-b73b-d87a0308d5b3, location=US}] Created a new job to upload record(s) to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}} (dataset medisage_airbyte_dataset): Job{job=JobId{project=data-analytics-386808, job=ca0b2efc-ae85-45d3-b73b-d87a0308d5b3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1687772249908, endTime=null, startTime=1687772250016, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=data-analytics-386808@appspot.gserviceaccount.com, etag=0pZPBSXb9FSV1Tl3e/l4sA==, generatedId=data-analytics-386808:US.ca0b2efc-ae85-45d3-b73b-d87a0308d5b3, selfLink=https://www.googleapis.com/bigquery/v2/projects/data-analytics-386808/jobs/ca0b2efc-ae85-45d3-b73b-d87a0308d5b3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, projectId=data-analytics-386808, tableId=_airbyte_raw_newsletters}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}
2023-06-26 09:37:30 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):443 Waiting for job finish Job{job=JobId{project=data-analytics-386808, job=ca0b2efc-ae85-45d3-b73b-d87a0308d5b3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1687772249908, endTime=null, startTime=1687772250016, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=data-analytics-386808@appspot.gserviceaccount.com, etag=0pZPBSXb9FSV1Tl3e/l4sA==, generatedId=data-analytics-386808:US.ca0b2efc-ae85-45d3-b73b-d87a0308d5b3, selfLink=https://www.googleapis.com/bigquery/v2/projects/data-analytics-386808/jobs/ca0b2efc-ae85-45d3-b73b-d87a0308d5b3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, projectId=data-analytics-386808, tableId=_airbyte_raw_newsletters}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null}
2023-06-26 09:37:35 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):445 Job finish Job{job=JobId{project=data-analytics-386808, job=ca0b2efc-ae85-45d3-b73b-d87a0308d5b3, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1687772249908, endTime=null, startTime=1687772250016, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=data-analytics-386808@appspot.gserviceaccount.com, etag=0pZPBSXb9FSV1Tl3e/l4sA==, generatedId=data-analytics-386808:US.ca0b2efc-ae85-45d3-b73b-d87a0308d5b3, selfLink=https://www.googleapis.com/bigquery/v2/projects/data-analytics-386808/jobs/ca0b2efc-ae85-45d3-b73b-d87a0308d5b3?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, projectId=data-analytics-386808, tableId=_airbyte_raw_newsletters}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null}
2023-06-26 09:37:35 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):152 [JobId{project=data-analytics-386808, job=ca0b2efc-ae85-45d3-b73b-d87a0308d5b3, location=US}] Target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}} (dataset medisage_airbyte_dataset) is successfully appended with staging files
2023-06-26 09:37:35 destination > INFO i.a.i.d.r.FileBuffer(deleteFile):109 Deleting tempFile data 066d0d8b-f108-4a18-892f-5776104577b02902240498800819591.avro
2023-06-26 09:37:35 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAllBuffers):139 Flushing completed for newsletters
2023-06-26 09:37:35 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(close):158 Closing buffer for stream newsletters
2023-06-26 09:37:35 INFO i.a.w.g.ReplicationWorkerHelper(processMessageFromDestination):234 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@6fe8575c[type=STATE,log=<null>,spec=<null>,connectionStatus=<null>,catalog=<null>,record=<null>,state=io.airbyte.protocol.models.AirbyteStateMessage@612fb4d1[type=STREAM,stream=io.airbyte.protocol.models.AirbyteStreamState@65103c2c[streamDescriptor=io.airbyte.protocol.models.StreamDescriptor@2012beea[name=newsletters,namespace=medisage2,additionalProperties={}],streamState={"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"577","cursor_record_count":1},additionalProperties={}],global=<null>,data={"cdc":false,"streams":[{"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"577","cursor_record_count":1}]},additionalProperties={}],trace=<null>,control=<null>,additionalProperties={}]
2023-06-26 09:37:35 INFO i.a.w.h.AirbyteMessageDataExtractor(getStreamFromMessage):42 - Extracting stream from state message: io.airbyte.protocol.models.AirbyteStreamState@65103c2c[streamDescriptor=io.airbyte.protocol.models.StreamDescriptor@2012beea[name=newsletters,namespace=medisage2,additionalProperties={}],streamState={"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"577","cursor_record_count":1},additionalProperties={}]
2023-06-26 09:37:35 INFO i.a.w.i.s.SyncPersistenceImpl(startBackgroundFlushStateTask):180 - starting state flush thread for connectionId 6400aad5-e2da-4d49-ad1c-42ec1179710d
2023-06-26 09:37:35 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):190 Cleaning up destination started for 1 streams
2023-06-26 09:37:35 destination > INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):186 Cleaning up staging path for stream newsletters (dataset medisage_airbyte_dataset): medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters
2023-06-26 09:37:35 destination > INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 Deleting object medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/b0a39bc7-71fb-4785-9759-dc23bef65968/0.avro
2023-06-26 09:37:35 destination > INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):306 Storage bucket medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters has been cleaned-up (1 objects were deleted)...
2023-06-26 09:37:35 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):194 Cleaning up destination completed.
2023-06-26 09:37:35 destination > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:37:35 destination > Destination process done (exit code 0)
2023-06-26 09:37:35 destination > Skipping in-connector normalization
2023-06-26 09:37:35 INFO i.a.w.g.DefaultReplicationWorker(replicate):208 - Source and destination threads complete.
2023-06-26 09:37:35 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:37:35 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):158 - sync summary: io.airbyte.config.StandardSyncOutput@588b5b19[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2490732e[status=completed,recordsSynced=575,bytesSynced=4915967,startTime=1687772240158,endTime=1687772255983,totalStats=io.airbyte.config.SyncStats@43b29c82[bytesCommitted=4915967,bytesEmitted=4915967,destinationStateMessagesEmitted=1,destinationWriteEndTime=1687772255982,destinationWriteStartTime=1687772240158,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=2,maxSecondsBeforeSourceStateMessageEmitted=2,maxSecondsBetweenStateMessageEmittedandCommitted=10,meanSecondsBetweenStateMessageEmittedandCommitted=10,recordsEmitted=575,recordsCommitted=575,replicationEndTime=1687772255983,replicationStartTime=1687772240158,sourceReadEndTime=1687772245524,sourceReadStartTime=1687772240193,sourceStateMessagesEmitted=1,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@32b74118[streamName=newsletters,streamNamespace=<null>,stats=io.airbyte.config.SyncStats@30e697c4[bytesCommitted=4915967,bytesEmitted=4915967,destinationStateMessagesEmitted=<null>,destinationWriteEndTime=<null>,destinationWriteStartTime=<null>,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=<null>,maxSecondsBeforeSourceStateMessageEmitted=<null>,maxSecondsBetweenStateMessageEmittedandCommitted=<null>,meanSecondsBetweenStateMessageEmittedandCommitted=<null>,recordsEmitted=575,recordsCommitted=575,replicationEndTime=<null>,replicationStartTime=<null>,sourceReadEndTime=<null>,sourceReadStartTime=<null>,sourceStateMessagesEmitted=<null>,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=<null>,webhookOperationSummary=<null>,state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@17c88bf5[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@40c94302[stream=io.airbyte.protocol.models.AirbyteStream@487e6582[name=newsletters,jsonSchema={"type":"object","properties":{"preview":{"type":"string"},"country":{"type":"string"},"newsletter_timestamp":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"newsletter_show":{"type":"boolean"},"created_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"description":{"type":"string"},"title":{"type":"string"},"meta_keywords":{"type":"string"},"json_data":{"type":"string"},"part_of_video":{"type":"boolean"},"image_name":{"type":"string"},"html_content":{"type":"string"},"partner_id":{"airbyte_type":"integer","type":"number"},"month_added":{"type":"string"},"updated_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"partner_division_id":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"url_link":{"type":"string"},"is_active":{"type":"boolean"},"meta_title":{"type":"string"},"file_name":{"type":"string"},"expiry_date":{"format":"date","type":"string"},"send_to_email":{"type":"boolean"},"ip_address":{"type":"string"},"email_file":{"type":"string"},"knowledge_category_id":{"airbyte_type":"integer","type":"number"},"created_by":{"airbyte_type":"integer","type":"number"},"deleted_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"tags":{"type":"string"},"meta_description":{"type":"string"},"is_open_newsletter":{"type":"boolean"},"newsletter_schedule":{"type":"boolean"},"translation":{"type":"string"},"last_seen_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"view_count":{"airbyte_type":"integer","type":"number"},"created_from":{"type":"string"},"reference_no":{"type":"string"},"video_id":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=incremental,cursorField=[id],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}]
2023-06-26 09:37:35 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):163 - Sync summary length: 4124
2023-06-26 09:37:35 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-06-26 09:37:36 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):128 - Using protocol v0
2023-06-26 09:37:36 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):148 - Using normalization: airbyte/normalization:0.4.3
2023-06-26 09:37:36 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/0/logs.log
2023-06-26 09:37:36 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:37:36 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION -----
2023-06-26 09:37:36 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):130 - Running with normalization version: airbyte/normalization:0.4.3
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization:0.4.3 exists...
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization:0.4.3 was found locally.
2023-06-26 09:37:36 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = normalization-normalize-33-0-pdgcn with resources io.airbyte.config.ResourceRequirements@107f658b[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-06-26 09:37:36 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/0/normalize --log-driver none --name normalization-normalize-33-0-pdgcn --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.50.4 airbyte/normalization:0.4.3 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json
2023-06-26 09:37:36 normalization > [FATAL tini (6)] exec /airbyte/entrypoint.sh failed: Exec format error
2023-06-26 09:37:36 INFO i.a.w.n.DefaultNormalizationRunner(close):196 - Terminating normalization process...
2023-06-26 09:37:36 ERROR i.a.w.g.DefaultNormalizationWorker(run):86 - Normalization failed for job 33.
io.airbyte.workers.exception.WorkerException: Normalization process did not terminate normally (exit code: 1)
	at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:207) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:84) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-06-26 09:37:36 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 0 seconds for job 33.
2023-06-26 09:37:36 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally...
io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:106) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-06-26 09:37:36 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:37:36 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-06-26 09:37:36 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=6bc73f64-415f-3d3e-9ebf-c684fb491eb6, activityType=Normalize, attempt=1
java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:119) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
	at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?]
	at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	... 14 more
Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	... 14 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:106) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	... 1 more
2023-06-26 09:37:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to Get a connection by connection Id
2023-06-26 09:37:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get the most recent source actor catalog
2023-06-26 09:37:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to Retrieve Id of the workspace for the source
2023-06-26 09:37:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to Get a connection by connection Id
2023-06-26 09:37:36 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/1/logs.log
2023-06-26 09:37:36 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:37:36 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:36 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-06-26 09:37:36 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:36 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:36 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:36 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-mysql:2.0.25 exists...
2023-06-26 09:37:36 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-mysql:2.0.25 was found locally.
2023-06-26 09:37:36 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = source-mysql-check-33-1-xidwy with resources io.airbyte.config.ResourceRequirements@6cac4b24[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@45fa19b9[hosts=[prod-read-replica.cpwmy4x3jsiq.ap-south-1.rds.amazonaws.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}]
2023-06-26 09:37:36 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/1 --log-driver none --name source-mysql-check-33-1-xidwy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-mysql:2.0.25 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/source-mysql:2.0.25 check --config source_config.json
2023-06-26 09:37:36 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:37:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.s.m.MySqlSource(main):452 starting source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:37:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json}
2023-06-26 09:37:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):106 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:37:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):107 Command: CHECK
2023-06-26 09:37:37 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2023-06-26 09:37:37 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:37 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.z.h.HikariDataSource(<init>):80 HikariPool-1 - Starting...
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.z.h.HikariDataSource(<init>):82 HikariPool-1 - Start completed.
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.s.j.AbstractJdbcSource(lambda$getCheckOperations$1):138 Attempting to get metadata from the database to see if we can connect.
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated...
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed.
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):195 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.s.m.MySqlSource(main):454 completed source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:37:38 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@66bee2d7[status=succeeded,message=<null>,additionalProperties={}]
2023-06-26 09:37:38 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:37:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:38 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-06-26 09:37:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:38 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/1/logs.log
2023-06-26 09:37:38 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:37:38 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:37:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:38 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-06-26 09:37:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:38 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:38 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:37:38 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-bigquery:1.4.4 exists...
2023-06-26 09:37:38 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-bigquery:1.4.4 was found locally.
2023-06-26 09:37:38 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = destination-bigquery-check-33-1-wdkxm with resources io.airbyte.config.ResourceRequirements@b8b0a38[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-06-26 09:37:38 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/1 --log-driver none --name destination-bigquery-check-33-1-wdkxm --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.4.4 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/destination-bigquery:1.4.4 check --config source_config.json
2023-06-26 09:37:38 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:37:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=source_config.json}
2023-06-26 09:37:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:37:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: CHECK
2023-06-26 09:37:39 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}
2023-06-26 09:37:39 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:39 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:39 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:40 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):419 Selected loading method is set to: GCS
2023-06-26 09:37:44 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 S3 format config: {"format_type":"CSV","flattening":"No flattening"}
2023-06-26 09:37:44 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3BaseChecks(testSingleUpload):40 Started testing if all required credentials assigned to user for single file uploading
2023-06-26 09:37:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3BaseChecks(testSingleUpload):48 Finished checking for normal upload mode
2023-06-26 09:37:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3BaseChecks(testMultipartUpload):52 Started testing if all required credentials assigned to user for multipart upload
2023-06-26 09:37:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/test_1687772266351 with full ID ABPnzm6C86NDXfthwSSKMX3e30bWr8QOhQBu752lyj0g7QX06x_HYYuLnAjZ8Fg7Mu3mfzk
2023-06-26 09:37:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-06-26 09:37:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-06-26 09:37:46 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):309 - WARN a.m.s.MultiPartOutputStream(close):160 [MultipartOutputStream for parts 1 - 10000] is already closed
2023-06-26 09:37:46 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.StreamTransferManager(complete):367 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/test_1687772266351 with id ABPnzm6C8...g7Mu3mfzk]: Uploading leftover stream [Part number 1 containing 3.34 MB]
2023-06-26 09:37:49 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/test_1687772266351 with id ABPnzm6C8...g7Mu3mfzk]: Finished uploading [Part number 1 containing 3.34 MB]
2023-06-26 09:37:50 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO a.m.s.StreamTransferManager(complete):395 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/test_1687772266351 with id ABPnzm6C8...g7Mu3mfzk]: Completed
2023-06-26 09:37:51 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.d.s.S3BaseChecks(testMultipartUpload):74 Finished verification for multipart upload mode
2023-06-26 09:37:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:37:52 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):312 - Destination process done (exit code 0)
2023-06-26 09:37:52 INFO i.a.w.g.DefaultCheckConnectionWorker(run):115 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@59142f54[status=succeeded,message=<null>,additionalProperties={}]
2023-06-26 09:37:52 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:37:52 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:52 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-06-26 09:37:52 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:52 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get state
2023-06-26 09:37:52 INFO i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: true, Normalization Supported: false, Feature Flag Enabled: false
2023-06-26 09:37:52 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to set attempt sync config
2023-06-26 09:37:52 INFO i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto
2023-06-26 09:37:53 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/1/logs.log
2023-06-26 09:37:53 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:37:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:37:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get the source definition for feature flag checks
2023-06-26 09:37:53 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get the source definition
2023-06-26 09:37:53 INFO i.a.w.g.ReplicationWorkerFactory(create):125 - Setting up source...
2023-06-26 09:37:53 INFO i.a.w.g.ReplicationWorkerFactory(create):132 - Setting up destination...
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable METRIC_CLIENT: ''
2023-06-26 09:37:53 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 
2023-06-26 09:37:53 INFO i.a.w.g.ReplicationWorkerFactory(create):144 - Setting up replication worker...
2023-06-26 09:37:53 INFO i.a.w.g.DefaultReplicationWorker(run):126 - start sync worker. job id: 33 attempt id: 1
2023-06-26 09:37:53 INFO i.a.w.g.DefaultReplicationWorker(run):131 - configured sync modes: {medisage2.newsletters=incremental - append_dedup}
2023-06-26 09:37:53 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:53 INFO i.a.w.g.DefaultReplicationWorker(run):143 - Committing states from replication activity
2023-06-26 09:37:53 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION -----
2023-06-26 09:37:53 INFO i.a.w.g.DefaultReplicationWorker(run):145 - Committing stats from replication activity
2023-06-26 09:37:53 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:37:53 INFO i.a.w.i.DefaultAirbyteDestination(start):88 - Running destination...
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:37:53 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-bigquery:1.4.4 exists...
2023-06-26 09:37:53 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-bigquery:1.4.4 was found locally.
2023-06-26 09:37:53 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = destination-bigquery-write-33-1-dwmop with resources io.airbyte.config.ResourceRequirements@567ad2fb[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-06-26 09:37:53 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/1 --log-driver none --name destination-bigquery-write-33-1-dwmop --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.4.4 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/destination-bigquery:1.4.4 write --config destination_config.json --catalog destination_catalog.json
2023-06-26 09:37:53 INFO i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0
2023-06-26 09:37:53 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-06-26 09:37:53 INFO i.a.c.EnvConfigs(getEnvOrDefault):1228 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-06-26 09:37:53 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-mysql:2.0.25 exists...
2023-06-26 09:37:53 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-mysql:2.0.25 was found locally.
2023-06-26 09:37:53 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = source-mysql-read-33-1-xdsrz with resources io.airbyte.config.ResourceRequirements@20a565e[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@4057ee98[hosts=[prod-read-replica.cpwmy4x3jsiq.ap-south-1.rds.amazonaws.com, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}]
2023-06-26 09:37:53 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/1 --log-driver none --name source-mysql-read-33-1-xdsrz --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-mysql:2.0.25 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT=config -e AIRBYTE_VERSION=0.50.4 -e WORKER_JOB_ID=33 airbyte/source-mysql:2.0.25 read --config source_config.json --catalog source_catalog.json --state input_state.json
2023-06-26 09:37:53 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):177 - Reading messages from protocol version 0.2.0
2023-06-26 09:37:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):228 - Destination output thread started.
2023-06-26 09:37:53 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes.
2023-06-26 09:37:53 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):272 - Replication thread started.
2023-06-26 09:37:54 source > INFO i.a.i.s.m.MySqlSource(main):452 starting source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:37:54 source > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, state=input_state.json, config=source_config.json}
2023-06-26 09:37:54 source > INFO i.a.i.b.IntegrationRunner(runInternal):106 Running integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:37:54 source > INFO i.a.i.b.IntegrationRunner(runInternal):107 Command: READ
2023-06-26 09:37:54 source > INFO i.a.i.b.IntegrationRunner(runInternal):108 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='input_state.json'}
2023-06-26 09:37:54 destination > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2023-06-26 09:37:54 destination > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:37:54 destination > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: WRITE
2023-06-26 09:37:54 destination > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2023-06-26 09:37:54 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:54 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:54 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:54 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:54 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword always_show - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-06-26 09:37:54 destination > INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):419 Selected loading method is set to: GCS
2023-06-26 09:37:54 destination > INFO i.a.i.d.s.S3FormatConfigs(getS3FormatConfig):22 S3 format config: {"format_type":"AVRO","flattening":"No flattening"}
2023-06-26 09:37:54 source > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL
2023-06-26 09:37:54 source > INFO i.a.i.s.r.s.StateManagerFactory(createStateManager):55 Stream state manager selected to manage state object with type STREAM.
2023-06-26 09:37:54 source > INFO i.a.i.s.r.s.CursorManager(createCursorInfoForStream):169 Found matching cursor in state. Stream: medisage2_newsletters. Cursor Field: id Value: 577 Count: 1
2023-06-26 09:37:54 destination > INFO i.a.i.d.b.BigQueryUtils(isKeepFilesInGcs):435 All tmp files will be removed from GCS when replication is finished
2023-06-26 09:37:54 source > INFO c.z.h.HikariDataSource(<init>):80 HikariPool-1 - Starting...
2023-06-26 09:37:54 source > INFO c.z.h.HikariDataSource(<init>):82 HikariPool-1 - Start completed.
2023-06-26 09:37:55 destination > INFO i.a.i.d.b.BigQueryDestination(getGcsRecordConsumer):325 Creating BigQuery staging message consumer with staging ID 2c75baad-2296-4ac9-85c3-033534eb3397 at 2023-06-26T09:37:54.757Z
2023-06-26 09:37:55 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$createWriteConfigs$1):92 BigQuery write config: BigQueryWriteConfig[streamName=newsletters, namespace=null, datasetId=medisage_airbyte_dataset, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_tmp_imb_newsletters}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]]
2023-06-26 09:37:55 destination > INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):144 class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2023-06-26 09:37:55 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):115 Preparing airbyte_raw tables in destination started for 1 streams
2023-06-26 09:37:55 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):117 Preparing staging are in destination for schema: Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, stream: newsletters, target table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}, stage: newsletters
2023-06-26 09:37:55 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createSchemaIfNotExists):86 Creating dataset medisage_airbyte_dataset
2023-06-26 09:37:55 source > INFO i.a.i.s.j.AbstractJdbcSource(logPreSyncDebugData):450 Data source product recognized as MySQL:5.7.38-log
2023-06-26 09:37:55 source > INFO i.a.i.s.j.AbstractJdbcSource(discoverInternal):166 Internal schemas to exclude: [information_schema, performance_schema, mysql, sys]
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"NO","COLUMN_KEY":"PRI","EXTRA":"auto_increment"}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"title","COLUMN_TYPE":"varchar(200)","IS_NULLABLE":"NO","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"partner_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"NO","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"image_name","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"preview","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"file_name","COLUMN_TYPE":"varchar(200)","IS_NULLABLE":"NO","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"description","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"is_active","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"1","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"ip_address","COLUMN_TYPE":"varchar(45)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"deleted_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"updated_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"partner_division_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"knowledge_category_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"view_count","COLUMN_TYPE":"int(11)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"last_seen_at","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"part_of_video","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"1","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"video_id","COLUMN_TYPE":"int(10) unsigned","IS_NULLABLE":"YES","COLUMN_KEY":"MUL","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"month_added","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_show","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_schedule","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"newsletter_timestamp","COLUMN_TYPE":"timestamp","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"send_to_email","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"email_file","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"is_open_newsletter","COLUMN_TYPE":"tinyint(1)","IS_NULLABLE":"NO","COLUMN_KEY":"","COLUMN_DEFAULT":"0","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"html_content","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"json_data","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_title","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_description","COLUMN_TYPE":"text","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"meta_keywords","COLUMN_TYPE":"text","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"expiry_date","COLUMN_TYPE":"date","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"reference_no","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_by","COLUMN_TYPE":"int(11)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"created_from","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"country","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"tags","COLUMN_TYPE":"longtext","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"translation","COLUMN_TYPE":"json","IS_NULLABLE":"YES","COLUMN_KEY":"","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(verifyCursorColumnValues):339 MySQL Table Structure {"COLUMN_NAME":"url_link","COLUMN_TYPE":"varchar(255)","IS_NULLABLE":"YES","COLUMN_KEY":"UNI","EXTRA":""}, medisage2, newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlSource(getIncrementalIterators):309 using CDC: false
2023-06-26 09:37:55 source > INFO i.a.i.s.j.AbstractJdbcSource(queryTableIncremental):320 Queueing query for table: newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.j.AbstractJdbcSource(lambda$queryTableIncremental$18):327 Preparing query for table: newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.j.AbstractJdbcSource(lambda$queryTableIncremental$18):337 Table newsletters cursor count: expected 1, actual 1
2023-06-26 09:37:55 source > INFO i.a.i.s.j.AbstractJdbcSource(lambda$queryTableIncremental$18):358 Executing query for table newsletters: HikariProxyPreparedStatement@990442552 wrapping com.mysql.cj.jdbc.ServerPreparedStatement[2]: SELECT `id`,`title`,`partner_id`,`image_name`,`preview`,`file_name`,`description`,`is_active`,`ip_address`,`deleted_at`,`created_at`,`updated_at`,`partner_division_id`,`knowledge_category_id`,`view_count`,`last_seen_at`,`part_of_video`,`video_id`,`month_added`,`newsletter_show`,`newsletter_schedule`,`newsletter_timestamp`,`send_to_email`,`email_file`,`is_open_newsletter`,`html_content`,`json_data`,`meta_title`,`meta_description`,`meta_keywords`,`expiry_date`,`reference_no`,`created_by`,`created_from`,`country`,`tags`,`translation`,`url_link` FROM `medisage2`.`newsletters` WHERE `id` > ** NOT SPECIFIED ** ORDER BY `id` ASC
2023-06-26 09:37:55 source > INFO i.a.i.s.m.MySqlStreamingQueryConfig(initialize):26 Set initial fetch size: -2147483648 rows
2023-06-26 09:37:55 source > INFO i.a.c.u.CompositeIterator(lambda$emitStartStreamStatus$1):155 STARTING -> medisage2_newsletters
2023-06-26 09:37:55 source > INFO i.a.c.u.CompositeIterator(lambda$emitRunningStreamStatus$0):148 RUNNING -> medisage2_newsletters
2023-06-26 09:37:55 source > INFO i.a.c.u.CompositeIterator(lambda$emitCompleteStreamStatus$2):162 COMPLETE -> medisage2_newsletters
2023-06-26 09:37:55 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):173 Closing database connection pool.
2023-06-26 09:37:55 source > INFO c.z.h.HikariDataSource(close):350 HikariPool-1 - Shutdown initiated...
2023-06-26 09:37:56 source > INFO c.z.h.HikariDataSource(close):352 HikariPool-1 - Shutdown completed.
2023-06-26 09:37:56 source > INFO i.a.i.s.r.AbstractDbSource(lambda$read$1):175 Closed database connection pool.
2023-06-26 09:37:56 source > INFO i.a.i.b.IntegrationRunner(runInternal):195 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedSource
2023-06-26 09:37:56 source > INFO i.a.i.s.m.MySqlSource(main):454 completed source: class io.airbyte.integrations.source.mysql.MySqlSource
2023-06-26 09:37:56 INFO i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):299 - Source has no more messages, closing connection.
2023-06-26 09:37:56 INFO i.a.w.g.ReplicationWorkerHelper(endOfSource):157 - Total records read: 5 (6 KB)
2023-06-26 09:37:56 INFO i.a.w.i.FieldSelector(reportMetrics):122 - Schema validation was performed to a max of 10 records with errors per stream.
2023-06-26 09:37:56 INFO i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true
2023-06-26 09:37:56 INFO i.a.w.g.DefaultReplicationWorker(replicate):201 - Waiting for source and destination threads to complete.
2023-06-26 09:37:56 INFO i.a.w.g.DefaultReplicationWorker(replicate):206 - One of source or destination thread complete. Waiting on the other.
2023-06-26 09:37:56 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createTableIfNotExists):102 Creating target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}
2023-06-26 09:37:57 destination > INFO i.a.i.d.b.BigQueryUtils(createPartitionedTableIfNotExists):224 Partitioned table ALREADY EXISTS: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}}
2023-06-26 09:37:57 destination > INFO i.a.i.d.b.BigQueryGcsOperations(createStageIfNotExists):109 Creating staging path for stream newsletters (dataset medisage_airbyte_dataset): medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/
2023-06-26 09:37:57 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onStartFunction$3):130 Preparing airbyte_raw tables in destination completed.
2023-06-26 09:37:57 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(lambda$getOrCreateBuffer$0):109 Starting a new buffer for stream newsletters (current state: 0 bytes in 0 buffers)
2023-06-26 09:37:57 destination > INFO i.a.i.d.g.u.GcsUtils(getDefaultAvroSchema):25 Default schema.
2023-06-26 09:37:57 destination > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded.
2023-06-26 09:37:57 destination > INFO i.a.i.d.b.BufferedStreamConsumer(close):255 executing on success close procedure.
2023-06-26 09:37:57 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAllBuffers):133 Flushing all 1 current buffers (0 bytes in total)
2023-06-26 09:37:57 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAllBuffers):137 Flushing buffer of stream newsletters (301 bytes)
2023-06-26 09:37:57 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$flushBufferFunction$4):147 Flushing buffer for stream newsletters (301 bytes) to staging
2023-06-26 09:37:57 destination > INFO i.a.i.d.r.BaseSerializedBuffer(flush):138 Finished writing data to debc8126-e615-4e8f-96c9-771e3fe2d7713036259657082716382.avro (6 KB)
2023-06-26 09:37:57 destination > INFO i.a.i.d.b.BigQueryGcsOperations(uploadRecordsToStage):116 Uploading records to staging for stream newsletters (dataset medisage_airbyte_dataset): medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/
2023-06-26 09:37:58 destination > INFO a.m.s.StreamTransferManager(getMultiPartOutputStreams):329 Initiated multipart upload to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro with full ID ABPnzm6UHTi8csvyeO58ykXxgF1W_oP6KeJv__OGCZFmfGEbWvLNm1tYtryEs7LV4QvHueA
2023-06-26 09:37:58 destination > INFO a.m.s.MultiPartOutputStream(close):158 Called close() on [MultipartOutputStream for parts 1 - 10000]
2023-06-26 09:37:58 destination > INFO a.m.s.StreamTransferManager(complete):367 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro with id ABPnzm6UH...LV4QvHueA]: Uploading leftover stream [Part number 1 containing 0.01 MB]
2023-06-26 09:37:58 destination > INFO a.m.s.StreamTransferManager(uploadStreamPart):558 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro with id ABPnzm6UH...LV4QvHueA]: Finished uploading [Part number 1 containing 0.01 MB]
2023-06-26 09:37:59 destination > INFO a.m.s.StreamTransferManager(complete):395 [Manager uploading to medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro with id ABPnzm6UH...LV4QvHueA]: Completed
2023-06-26 09:37:59 destination > INFO i.a.i.d.s.S3StorageOperations(loadDataIntoBucket):214 Uploaded buffer file to storage: debc8126-e615-4e8f-96c9-771e3fe2d7713036259657082716382.avro -> medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro (filename: 0.avro)
2023-06-26 09:37:59 destination > INFO i.a.i.d.s.S3StorageOperations(uploadRecordsToBucket):131 Successfully loaded records to stage medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/ with 0 re-attempt(s)
2023-06-26 09:37:59 destination > INFO i.a.i.d.b.BigQueryWriteConfig(addStagedFile):61 Added staged file: 0.avro
2023-06-26 09:37:59 destination > INFO i.a.i.d.b.BigQueryGcsOperations(copyIntoTableFromStage):133 Uploading records from staging files to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}} (dataset medisage_airbyte_dataset): [0.avro]
2023-06-26 09:37:59 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):138 Uploading staged file: gs://medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro
2023-06-26 09:38:00 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):147 [JobId{project=data-analytics-386808, job=e0f7d707-f65c-400a-ba67-2b7048469362, location=US}] Created a new job to upload record(s) to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}} (dataset medisage_airbyte_dataset): Job{job=JobId{project=data-analytics-386808, job=e0f7d707-f65c-400a-ba67-2b7048469362, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1687772280046, endTime=null, startTime=1687772280160, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=data-analytics-386808@appspot.gserviceaccount.com, etag=KYGLQ0wG5ZxMhrVOzTxyVg==, generatedId=data-analytics-386808:US.e0f7d707-f65c-400a-ba67-2b7048469362, selfLink=https://www.googleapis.com/bigquery/v2/projects/data-analytics-386808/jobs/e0f7d707-f65c-400a-ba67-2b7048469362?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, projectId=data-analytics-386808, tableId=_airbyte_raw_newsletters}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}
2023-06-26 09:38:00 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):443 Waiting for job finish Job{job=JobId{project=data-analytics-386808, job=e0f7d707-f65c-400a-ba67-2b7048469362, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1687772280046, endTime=null, startTime=1687772280160, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=data-analytics-386808@appspot.gserviceaccount.com, etag=KYGLQ0wG5ZxMhrVOzTxyVg==, generatedId=data-analytics-386808:US.e0f7d707-f65c-400a-ba67-2b7048469362, selfLink=https://www.googleapis.com/bigquery/v2/projects/data-analytics-386808/jobs/e0f7d707-f65c-400a-ba67-2b7048469362?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, projectId=data-analytics-386808, tableId=_airbyte_raw_newsletters}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}}. Status: JobStatus{state=RUNNING, error=null, executionErrors=null}
2023-06-26 09:38:03 destination > INFO i.a.i.d.b.BigQueryUtils(waitForJobFinish):445 Job finish Job{job=JobId{project=data-analytics-386808, job=e0f7d707-f65c-400a-ba67-2b7048469362, location=US}, status=JobStatus{state=RUNNING, error=null, executionErrors=null}, statistics=LoadStatistics{creationTime=1687772280046, endTime=null, startTime=1687772280160, numChildJobs=null, parentJobId=null, scriptStatistics=null, reservationUsage=null, inputBytes=null, inputFiles=null, outputBytes=null, outputRows=null, badRecords=null}, userEmail=data-analytics-386808@appspot.gserviceaccount.com, etag=KYGLQ0wG5ZxMhrVOzTxyVg==, generatedId=data-analytics-386808:US.e0f7d707-f65c-400a-ba67-2b7048469362, selfLink=https://www.googleapis.com/bigquery/v2/projects/data-analytics-386808/jobs/e0f7d707-f65c-400a-ba67-2b7048469362?location=US, configuration=LoadJobConfiguration{type=LOAD, destinationTable=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, projectId=data-analytics-386808, tableId=_airbyte_raw_newsletters}}, decimalTargetTypes=null, destinationEncryptionConfiguration=null, createDisposition=null, writeDisposition=WRITE_APPEND, formatOptions=FormatOptions{format=AVRO}, nullMarker=null, maxBadRecords=null, schema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, ignoreUnknownValue=null, sourceUris=[gs://medisage_airbyte_bucket-1/medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro], schemaUpdateOptions=null, autodetect=null, timePartitioning=null, clustering=null, useAvroLogicalTypes=true, labels=null, jobTimeoutMs=null, rangePartitioning=null, hivePartitioningOptions=null}} with status JobStatus{state=RUNNING, error=null, executionErrors=null}
2023-06-26 09:38:03 destination > INFO i.a.i.d.b.BigQueryGcsOperations(lambda$copyIntoTableFromStage$0):152 [JobId{project=data-analytics-386808, job=e0f7d707-f65c-400a-ba67-2b7048469362, location=US}] Target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=medisage_airbyte_dataset, tableId=_airbyte_raw_newsletters}} (dataset medisage_airbyte_dataset) is successfully appended with staging files
2023-06-26 09:38:03 destination > INFO i.a.i.d.r.FileBuffer(deleteFile):109 Deleting tempFile data debc8126-e615-4e8f-96c9-771e3fe2d7713036259657082716382.avro
2023-06-26 09:38:03 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(flushAllBuffers):139 Flushing completed for newsletters
2023-06-26 09:38:03 destination > INFO i.a.i.d.r.SerializedBufferingStrategy(close):158 Closing buffer for stream newsletters
2023-06-26 09:38:03 INFO i.a.w.g.ReplicationWorkerHelper(processMessageFromDestination):234 - State in DefaultReplicationWorker from destination: io.airbyte.protocol.models.AirbyteMessage@58ed3825[type=STATE,log=<null>,spec=<null>,connectionStatus=<null>,catalog=<null>,record=<null>,state=io.airbyte.protocol.models.AirbyteStateMessage@562acd48[type=STREAM,stream=io.airbyte.protocol.models.AirbyteStreamState@52155355[streamDescriptor=io.airbyte.protocol.models.StreamDescriptor@1717c773[name=newsletters,namespace=medisage2,additionalProperties={}],streamState={"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"578","cursor_record_count":1},additionalProperties={}],global=<null>,data={"cdc":false,"streams":[{"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"578","cursor_record_count":1}]},additionalProperties={}],trace=<null>,control=<null>,additionalProperties={}]
2023-06-26 09:38:03 INFO i.a.w.h.AirbyteMessageDataExtractor(getStreamFromMessage):42 - Extracting stream from state message: io.airbyte.protocol.models.AirbyteStreamState@52155355[streamDescriptor=io.airbyte.protocol.models.StreamDescriptor@1717c773[name=newsletters,namespace=medisage2,additionalProperties={}],streamState={"stream_name":"newsletters","stream_namespace":"medisage2","cursor_field":["id"],"cursor":"578","cursor_record_count":1},additionalProperties={}]
2023-06-26 09:38:03 INFO i.a.w.i.s.SyncPersistenceImpl(startBackgroundFlushStateTask):180 - starting state flush thread for connectionId 6400aad5-e2da-4d49-ad1c-42ec1179710d
2023-06-26 09:38:03 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):190 Cleaning up destination started for 1 streams
2023-06-26 09:38:03 destination > INFO i.a.i.d.b.BigQueryGcsOperations(dropStageIfExists):186 Cleaning up staging path for stream newsletters (dataset medisage_airbyte_dataset): medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters
2023-06-26 09:38:03 destination > INFO i.a.i.d.g.GcsStorageOperations(cleanUpObjects):43 Deleting object medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters/2023/06/26/09/2c75baad-2296-4ac9-85c3-033534eb3397/0.avro
2023-06-26 09:38:04 destination > INFO i.a.i.d.s.S3StorageOperations(cleanUpBucketObject):306 Storage bucket medisage_airbyte_bucket-1/medisage_airbyte_dataset_newsletters has been cleaned-up (1 objects were deleted)...
2023-06-26 09:38:04 destination > INFO i.a.i.d.b.BigQueryStagingConsumerFactory(lambda$onCloseFunction$5):194 Cleaning up destination completed.
2023-06-26 09:38:04 destination > INFO i.a.i.b.IntegrationRunner(runInternal):186 Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination
2023-06-26 09:38:04 destination > Destination process done (exit code 0)
2023-06-26 09:38:04 destination > Skipping in-connector normalization
2023-06-26 09:38:04 INFO i.a.w.g.DefaultReplicationWorker(replicate):208 - Source and destination threads complete.
2023-06-26 09:38:04 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:38:04 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):158 - sync summary: io.airbyte.config.StandardSyncOutput@7ccb5c11[standardSyncSummary=io.airbyte.config.StandardSyncSummary@2a460fd2[status=completed,recordsSynced=1,bytesSynced=6600,startTime=1687772273139,endTime=1687772284325,totalStats=io.airbyte.config.SyncStats@6a60d5d2[bytesCommitted=6600,bytesEmitted=6600,destinationStateMessagesEmitted=1,destinationWriteEndTime=1687772284324,destinationWriteStartTime=1687772273139,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=8,meanSecondsBetweenStateMessageEmittedandCommitted=8,recordsEmitted=1,recordsCommitted=1,replicationEndTime=1687772284325,replicationStartTime=1687772273139,sourceReadEndTime=1687772276107,sourceReadStartTime=1687772273173,sourceStateMessagesEmitted=1,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@48b51bec[streamName=newsletters,streamNamespace=<null>,stats=io.airbyte.config.SyncStats@6eb8ed3f[bytesCommitted=6600,bytesEmitted=6600,destinationStateMessagesEmitted=<null>,destinationWriteEndTime=<null>,destinationWriteStartTime=<null>,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=<null>,maxSecondsBeforeSourceStateMessageEmitted=<null>,maxSecondsBetweenStateMessageEmittedandCommitted=<null>,meanSecondsBetweenStateMessageEmittedandCommitted=<null>,recordsEmitted=1,recordsCommitted=1,replicationEndTime=<null>,replicationStartTime=<null>,sourceReadEndTime=<null>,sourceReadStartTime=<null>,sourceStateMessagesEmitted=<null>,additionalProperties={}],additionalProperties={}]],additionalProperties={}],normalizationSummary=<null>,webhookOperationSummary=<null>,state=<null>,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@749a47a5[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@18b8c2a1[stream=io.airbyte.protocol.models.AirbyteStream@7832c021[name=newsletters,jsonSchema={"type":"object","properties":{"preview":{"type":"string"},"country":{"type":"string"},"newsletter_timestamp":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"newsletter_show":{"type":"boolean"},"created_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"description":{"type":"string"},"title":{"type":"string"},"meta_keywords":{"type":"string"},"json_data":{"type":"string"},"part_of_video":{"type":"boolean"},"image_name":{"type":"string"},"html_content":{"type":"string"},"partner_id":{"airbyte_type":"integer","type":"number"},"month_added":{"type":"string"},"updated_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"partner_division_id":{"airbyte_type":"integer","type":"number"},"id":{"airbyte_type":"integer","type":"number"},"url_link":{"type":"string"},"is_active":{"type":"boolean"},"meta_title":{"type":"string"},"file_name":{"type":"string"},"expiry_date":{"format":"date","type":"string"},"send_to_email":{"type":"boolean"},"ip_address":{"type":"string"},"email_file":{"type":"string"},"knowledge_category_id":{"airbyte_type":"integer","type":"number"},"created_by":{"airbyte_type":"integer","type":"number"},"deleted_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"tags":{"type":"string"},"meta_description":{"type":"string"},"is_open_newsletter":{"type":"boolean"},"newsletter_schedule":{"type":"boolean"},"translation":{"type":"string"},"last_seen_at":{"format":"date-time","airbyte_type":"timestamp_with_timezone","type":"string"},"view_count":{"airbyte_type":"integer","type":"number"},"created_from":{"type":"string"},"reference_no":{"type":"string"},"video_id":{"airbyte_type":"integer","type":"number"}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=<null>,defaultCursorField=[],sourceDefinedPrimaryKey=[[id]],namespace=<null>,additionalProperties={}],syncMode=incremental,cursorField=[id],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[],commitStateAsap=true,additionalProperties={}]
2023-06-26 09:38:04 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):163 - Sync summary length: 4097
2023-06-26 09:38:04 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-06-26 09:38:04 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):128 - Using protocol v0
2023-06-26 09:38:04 INFO i.a.w.t.s.NormalizationActivityImpl(lambda$normalize$3):148 - Using normalization: airbyte/normalization:0.4.3
2023-06-26 09:38:04 INFO i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/33/1/logs.log
2023-06-26 09:38:04 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.50.4
2023-06-26 09:38:04 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to save workflow id for cancellation
2023-06-26 09:38:04 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:04 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START DEFAULT NORMALIZATION -----
2023-06-26 09:38:04 INFO i.a.w.n.DefaultNormalizationRunner(runProcess):130 - Running with normalization version: airbyte/normalization:0.4.3
2023-06-26 09:38:04 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-06-26 09:38:04 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/normalization:0.4.3 exists...
2023-06-26 09:38:04 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/normalization:0.4.3 was found locally.
2023-06-26 09:38:04 INFO i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = normalization-normalize-33-1-kuynb with resources io.airbyte.config.ResourceRequirements@5c996862[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-06-26 09:38:04 INFO i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/33/1/normalize --log-driver none --name normalization-normalize-33-1-kuynb --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_VERSION=0.50.4 airbyte/normalization:0.4.3 run --integration-type bigquery --config destination_config.json --catalog destination_catalog.json
2023-06-26 09:38:04 normalization > [FATAL tini (7)] exec /airbyte/entrypoint.sh failed: Exec format error
2023-06-26 09:38:04 INFO i.a.w.n.DefaultNormalizationRunner(close):196 - Terminating normalization process...
2023-06-26 09:38:04 ERROR i.a.w.g.DefaultNormalizationWorker(run):86 - Normalization failed for job 33.
io.airbyte.workers.exception.WorkerException: Normalization process did not terminate normally (exit code: 1)
	at io.airbyte.workers.normalization.DefaultNormalizationRunner.close(DefaultNormalizationRunner.java:207) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:84) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-06-26 09:38:04 INFO i.a.w.g.DefaultNormalizationWorker(run):97 - Normalization executed in 0 seconds for job 33.
2023-06-26 09:38:04 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$5):198 - Completing future exceptionally...
io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:106) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
2023-06-26 09:38:04 INFO i.a.w.t.TemporalAttemptExecution(get):163 - Stopping cancellation check scheduling...
2023-06-26 09:38:04 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):307 - Stopping temporal heartbeating...
2023-06-26 09:38:04 WARN i.t.i.a.ActivityTaskExecutors$BaseActivityTaskExecutor(execute):114 - Activity failure. ActivityId=f5a05319-a1c8-35d8-bd4e-450911d3c59d, activityType=Normalize, attempt=1
java.lang.RuntimeException: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:305) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.normalize(NormalizationActivityImpl.java:119) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:104) ~[?:?]
	at java.lang.reflect.Method.invoke(Method.java:578) ~[?:?]
	at io.temporal.internal.activity.RootActivityInboundCallsInterceptor$POJOActivityInboundCallsInterceptor.executeActivity(RootActivityInboundCallsInterceptor.java:64) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.RootActivityInboundCallsInterceptor.execute(RootActivityInboundCallsInterceptor.java:43) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.ActivityTaskExecutors$BaseActivityTaskExecutor.execute(ActivityTaskExecutors.java:95) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.activity.ActivityTaskHandlerImpl.handle(ActivityTaskHandlerImpl.java:92) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handleActivity(ActivityWorker.java:241) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:206) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:179) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:93) ~[temporal-sdk-1.17.0.jar:?]
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
	at java.lang.Thread.run(Thread.java:1589) ~[?:?]
Caused by: io.temporal.serviceclient.CheckedExceptionWrapper: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.temporal.serviceclient.CheckedExceptionWrapper.wrap(CheckedExceptionWrapper.java:57) ~[temporal-serviceclient-1.17.0.jar:?]
	at io.temporal.internal.sync.WorkflowInternal.wrap(WorkflowInternal.java:461) ~[temporal-sdk-1.17.0.jar:?]
	at io.temporal.activity.Activity.wrap(Activity.java:52) ~[temporal-sdk-1.17.0.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	... 14 more
Caused by: java.util.concurrent.ExecutionException: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]
	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.workers.temporal.sync.NormalizationActivityImpl.lambda$normalize$3(NormalizationActivityImpl.java:167) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	at io.airbyte.commons.temporal.TemporalUtils.withBackgroundHeartbeat(TemporalUtils.java:300) ~[io.airbyte-airbyte-commons-temporal-0.50.4.jar:?]
	... 14 more
Caused by: io.airbyte.workers.exception.WorkerException: Normalization Failed.
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:106) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.general.DefaultNormalizationWorker.run(DefaultNormalizationWorker.java:37) ~[io.airbyte-airbyte-commons-worker-0.50.4.jar:?]
	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$5(TemporalAttemptExecution.java:195) ~[io.airbyte-airbyte-workers-0.50.4.jar:?]
	... 1 more
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to Get a connection by connection Id
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to get the most recent source actor catalog
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to Retrieve Id of the workspace for the source
2023-06-26 09:38:21 INFO i.a.a.c.AirbyteApiClient(retryWithJitterThrows):229 - Attempt 0 to Get a connection by connection Id