2022-10-10 14:21:06 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.method: must be a constant value Standard 2022-10-10 14:21:06 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.credential.hmac_key_secret: object found, string expected, $.credential.hmac_key_access_id: object found, string expected 2022-10-10 14:21:06 INFO i.a.a.LoggingTrackingClient(track):43 - track. version: null, userId: null, action: Connector Jobs, metadata: {job_type=sync, config.destination.big_query_client_buffer_size_mb=set, namespace_definition=customformat, config.source.conversion_window_days=set, config.destination.dataset_location=US, frequency=manual, connector_source_definition_id=2a2552ca-9f78-4c1c-9eb7-4d0dc66d72df, workspace_id=12dbcf62-bf38-40be-8df2-287441f1b9c3, attempt_stage=STARTED, config.source.api_secret._secret=set, config.destination.project_id=set, attempt_id=1, connector_destination=BigQuery, catalog.sync_mode.incremental=set, connector_destination_docker_repository=airbyte/destination-bigquery, table_prefix=false, config.destination.credentials_json._secret=set, workspace_name=12dbcf62-bf38-40be-8df2-287441f1b9c3, config.source.start_date=set, number_of_streams=1, config.destination.dataset_id=set, catalog.destination_sync_mode.append_dedup=set, connector_source=WooCommerce, config.destination.transformation_priority=interactive, connector_source_docker_repository=airbyte/source-woocommerce, connection_id=944e156f-c3f8-49bd-81e0-ffc15e9e2f9f, job_id=14, connector_source_version=0.1.2, connector_destination_version=1.2.4, config.source.api_key._secret=set, operation.normalization=1, config.source.shop=set, operation_count=1, connector_destination_definition_id=22f6c74f-5699-40ff-833c-4a879ea40133} 2022-10-10 14:21:06 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/0/logs.log 2022-10-10 14:21:06 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:21:06 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:06 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-10 14:21:06 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:06 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-woocommerce:0.1.2 exists... 2022-10-10 14:21:06 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-woocommerce:0.1.2 was found locally. 2022-10-10 14:21:06 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-woocommerce-check-14-0-xzxpo with resources io.airbyte.config.ResourceRequirements@10c87fd[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:06 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/0 --log-driver none --name source-woocommerce-check-14-0-xzxpo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-woocommerce:0.1.2 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/source-woocommerce:0.1.2 check --config source_config.json 2022-10-10 14:21:08 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-10 14:21:08 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:21:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:08 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-10 14:21:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:08 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/0/logs.log 2022-10-10 14:21:08 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:21:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:08 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-10 14:21:08 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:08 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-bigquery:1.2.4 exists... 2022-10-10 14:21:08 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-bigquery:1.2.4 was found locally. 2022-10-10 14:21:08 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-bigquery-check-14-0-mcdkh with resources io.airbyte.config.ResourceRequirements@10c87fd[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:08 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/0 --log-driver none --name destination-bigquery-check-14-0-mcdkh --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.2.4 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/destination-bigquery:1.2.4 check --config source_config.json 2022-10-10 14:21:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - integration args: {check=null, config=source_config.json} 2022-10-10 14:21:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Command: CHECK 2022-10-10 14:21:10 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-10 14:21:10 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:10 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:11 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Selected loading method is set to: GCS 2022-10-10 14:21:12 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - S3 format config: {"format_type":"CSV","flattening":"No flattening"} 2022-10-10 14:21:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Started testing if all required credentials assigned to user for single file uploading 2022-10-10 14:21:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Finished checking for normal upload mode 2022-10-10 14:21:13 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Started testing if all required credentials assigned to user for multipart upload 2022-10-10 14:21:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Initiated multipart upload to airbyte-preload-staging/airbyte-preload-staging/test_1665411673883 with full ID ABPnzm6cY_FCuvnf0mNy_Cwbl41IRRR0Jic93EfVhhWTsTkDGZHoHOxJ4dOd-RHYemgzJ2o 2022-10-10 14:21:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-10 14:21:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-10 14:21:14 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-10-10 14:21:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411673883 with id ABPnzm6cY...HYemgzJ2o]: Uploading leftover stream [Part number 1 containing 3.34 MB] 2022-10-10 14:21:14 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411673883 with id ABPnzm6cY...HYemgzJ2o]: Finished uploading [Part number 1 containing 3.34 MB] 2022-10-10 14:21:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411673883 with id ABPnzm6cY...HYemgzJ2o]: Completed 2022-10-10 14:21:15 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Finished verification for multipart upload mode 2022-10-10 14:21:16 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:16 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:16 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/0/logs.log 2022-10-10 14:21:16 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:21:16 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-10 14:21:16 INFO i.a.c.EnvConfigs(getEnvOrDefault):1072 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-10 14:21:16 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-10 14:21:16 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-10 14:21:16 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 14 attempt id: 0 2022-10-10 14:21:16 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.customers=incremental - append_dedup} 2022-10-10 14:21:16 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-bigquery:1.2.4 exists... 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-bigquery:1.2.4 was found locally. 2022-10-10 14:21:16 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-bigquery-write-14-0-hauui with resources io.airbyte.config.ResourceRequirements@558cc2b7[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:16 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/0 --log-driver none --name destination-bigquery-write-14-0-hauui --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.2.4 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/destination-bigquery:1.2.4 write --config destination_config.json --catalog destination_catalog.json 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-woocommerce:0.1.2 exists... 2022-10-10 14:21:16 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-woocommerce:0.1.2 was found locally. 2022-10-10 14:21:16 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-woocommerce-read-14-0-acpez with resources io.airbyte.config.ResourceRequirements@11aa0b1[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:16 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/0 --log-driver none --name source-woocommerce-read-14-0-acpez --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-woocommerce:0.1.2 -e WORKER_JOB_ATTEMPT=0 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/source-woocommerce:0.1.2 read --config source_config.json --catalog source_catalog.json 2022-10-10 14:21:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-10 14:21:16 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-10 14:21:16 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-10 14:21:17 source > Starting syncing SourceWoocommerce 2022-10-10 14:21:17 source > Syncing stream: customers 2022-10-10 14:21:18 source > using params: {'per_page': 100, 'after': DateTime(2022, 1, 1, 0, 0, 0), 'before': DateTime(2022, 10, 10, 14, 21, 17, 512416), 'orderby': 'registered_date', 'order': 'asc'} 2022-10-10 14:21:18 source > {"code":"woocommerce_rest_cannot_view","message":"Sorry, you cannot list resources.","data":{"status":401}} 2022-10-10 14:21:18 source > Encountered an exception while reading stream customers Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A17.512416&orderby=registered_date&order=asc 2022-10-10 14:21:18 source > Finished syncing customers 2022-10-10 14:21:18 source > SourceWoocommerce runtimes: Syncing stream customers 0:00:00.736218 2022-10-10 14:21:18 source > 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A17.512416&orderby=registered_date&order=asc Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A17.512416&orderby=registered_date&order=asc The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 127, in read raise AirbyteTracedException.from_exception(e, message=display_message) from e airbyte_cdk.utils.traced_exception.AirbyteTracedException: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A17.512416&orderby=registered_date&order=asc 2022-10-10 14:21:18 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-10 14:21:19 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-10 14:21:19 destination > Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:19 destination > Command: WRITE 2022-10-10 14:21:19 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-10 14:21:19 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:19 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:19 destination > Selected loading method is set to: GCS 2022-10-10 14:21:19 destination > S3 format config: {"format_type":"AVRO","flattening":"No flattening"} 2022-10-10 14:21:19 destination > All tmp files will be removed from GCS when replication is finished 2022-10-10 14:21:20 destination > Creating BigQuery staging message consumer with staging ID 45a3ab38-1f07-4151-ac2a-668b82b3f732 at 2022-10-10T14:21:19.735Z 2022-10-10 14:21:20 destination > BigQuery write config: BigQueryWriteConfig[streamName=customers, namespace=raw_woo_commerce, datasetId=raw_woo_commerce, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_cmu_customers}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]] 2022-10-10 14:21:20 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-10-10 14:21:20 destination > Preparing tmp tables in destination started for 1 streams 2022-10-10 14:21:20 destination > Creating dataset raw_woo_commerce 2022-10-10 14:21:21 destination > Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_cmu_customers}} 2022-10-10 14:21:21 destination > Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_cmu_customers}} 2022-10-10 14:21:22 destination > Creating staging path for stream customers (dataset raw_woo_commerce): airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/45a3ab38-1f07-4151-ac2a-668b82b3f732/ 2022-10-10 14:21:22 destination > Storage Object airbyte-preload-staging/airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/45a3ab38-1f07-4151-ac2a-668b82b3f732/ does not exist in bucket; creating... 2022-10-10 14:21:22 destination > Storage Object airbyte-preload-staging/airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/45a3ab38-1f07-4151-ac2a-668b82b3f732/ has been created in bucket. 2022-10-10 14:21:22 destination > Preparing tmp tables in destination completed. 2022-10-10 14:21:22 destination > Airbyte message consumer: succeeded. 2022-10-10 14:21:22 destination > executing on success close procedure. 2022-10-10 14:21:22 destination > Flushing all 0 current buffers (0 bytes in total) 2022-10-10 14:21:22 destination > Copying into tables in destination started for 1 streams 2022-10-10 14:21:22 destination > Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_cmu_customers}} (dataset raw_woo_commerce): [] 2022-10-10 14:21:22 destination > Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_cmu_customers}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}} (dataset raw_woo_commerce, sync mode append_dedup) 2022-10-10 14:21:27 destination > successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_cmu_customers}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}} 2022-10-10 14:21:27 destination > Finalizing tables in destination completed 2022-10-10 14:21:27 destination > Cleaning up destination started for 1 streams 2022-10-10 14:21:27 destination > Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_cmu_customers}} (dataset raw_woo_commerce) 2022-10-10 14:21:28 destination > Cleaning up staging path for stream customers (dataset raw_woo_commerce): airbyte-preload-staging/raw_woo_commerce_customers 2022-10-10 14:21:28 destination > Deleting object airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/45a3ab38-1f07-4151-ac2a-668b82b3f732/ 2022-10-10 14:21:28 destination > Storage bucket airbyte-preload-staging/raw_woo_commerce_customers has been cleaned-up (1 objects were deleted)... 2022-10-10 14:21:28 destination > Cleaning up destination completed. 2022-10-10 14:21:28 destination > Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:28 ERROR i.a.w.g.DefaultReplicationWorker(run):188 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:181) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:68) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:145) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:68) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-10-10 14:21:28 INFO i.a.w.g.DefaultReplicationWorker(run):281 - Source did not output any state messages 2022-10-10 14:21:28 WARN i.a.w.g.DefaultReplicationWorker(run):292 - State capture: No state retained. 2022-10-10 14:21:28 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "failed", "recordsSynced" : 0, "bytesSynced" : 0, "startTime" : 1665411676371, "endTime" : 1665411688418, "totalStats" : { "recordsEmitted" : 0, "bytesEmitted" : 0, "sourceStateMessagesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "recordsCommitted" : 0, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0 }, "streamStats" : [ ] } 2022-10-10 14:21:28 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ { "failureOrigin" : "source", "failureType" : "system_error", "internalMessage" : "401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A17.512416&orderby=registered_date&order=asc", "externalMessage" : "Sorry, you cannot list resources.", "metadata" : { "attemptNumber" : 0, "jobId" : 14, "from_trace_message" : true, "connector_command" : "read" }, "stacktrace" : "Traceback (most recent call last):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 114, in read\n yield from self._read_stream(\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 179, in _read_stream\n for record in record_iterator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 241, in _read_incremental\n for record_counter, record_data in enumerate(records, start=1):\n File \"/airbyte/integration_code/source_woocommerce/source.py\", line 154, in read_records\n yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice)\n File \"/airbyte/integration_code/source_woocommerce/source.py\", line 135, in filter_records_newer_than_state\n for record in records_slice:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 421, in read_records\n response = self._send_request(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 339, in _send_request\n return backoff_handler(user_backoff_handler)(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 306, in _send\n raise exc\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 303, in _send\n response.raise_for_status()\n File \"/usr/local/lib/python3.9/site-packages/requests/models.py\", line 1021, in raise_for_status\n raise HTTPError(http_error_msg, response=self)\nrequests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A17.512416&orderby=registered_date&order=asc\n", "timestamp" : 1665411678253 }, { "failureOrigin" : "source", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!", "externalMessage" : "Something went wrong within the source connector", "metadata" : { "attemptNumber" : 0, "jobId" : 14, "connector_command" : "read" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:833)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\nCaused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357)\n\t... 4 more\n", "timestamp" : 1665411678504 } ] 2022-10-10 14:21:28 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:21:28 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):159 - sync summary: io.airbyte.config.StandardSyncOutput@3ad55637[standardSyncSummary=io.airbyte.config.StandardSyncSummary@7fd7cf09[status=failed,recordsSynced=0,bytesSynced=0,startTime=1665411676371,endTime=1665411688418,totalStats=io.airbyte.config.SyncStats@264912b1[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@4e62901f[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@5e16130a[stream=io.airbyte.protocol.models.AirbyteStream@1ff83046[name=customers,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"role":{"type":["null","string"]},"email":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"self":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}},"collection":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}}},"billing":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"email":{"type":["null","string"]},"phone":{"type":["null","string"]},"state":{"type":["null","string"]},"company":{"type":["null","string"]},"country":{"type":["null","string"]},"postcode":{"type":["null","string"]},"address_1":{"type":["null","string"]},"address_2":{"type":["null","string"]},"last_name":{"type":["null","string"]},"first_name":{"type":["null","string"]}}},"shipping":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"state":{"type":["null","string"]},"company":{"type":["null","string"]},"country":{"type":["null","string"]},"postcode":{"type":["null","string"]},"address_1":{"type":["null","string"]},"address_2":{"type":["null","string"]},"last_name":{"type":["null","string"]},"first_name":{"type":["null","string"]}}},"shop_url":{"type":["null","string"]},"username":{"type":["null","string"]},"last_name":{"type":["null","string"]},"meta_data":{"type":["null","array","object"],"oneOf":[{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"key":{"type":["null","string"]},"value":{"type":["null","object","string"]}}},{"type":"array","items":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"key":{"type":["null","string"]},"value":{"type":["null","object","string"]}}}}]},"avatar_url":{"type":["null","string"]},"first_name":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_modified":{"type":["null","string"],"format":"date-time"},"date_created_gmt":{"type":["null","string"],"format":"date-time"},"date_modified_gmt":{"type":["null","string"],"format":"date-time"},"is_paying_customer":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_created],sourceDefinedPrimaryKey=[[id]],namespace=raw_woo_commerce,additionalProperties={}],syncMode=incremental,cursorField=[date_created],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@71ca7592[failureOrigin=source,failureType=system_error,internalMessage=401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A17.512416&orderby=registered_date&order=asc,externalMessage=Sorry, you cannot list resources.,metadata=io.airbyte.config.Metadata@2b72e1dc[additionalProperties={attemptNumber=0, jobId=14, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A17.512416&orderby=registered_date&order=asc ,retryable=,timestamp=1665411678253], io.airbyte.config.FailureReason@451239fb[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@1bb64b1f[additionalProperties={attemptNumber=0, jobId=14, connector_command=read}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357) ... 4 more ,retryable=,timestamp=1665411678504]]] 2022-10-10 14:21:28 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-10 14:21:28 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:28 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-10 14:21:28 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:28 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.method: must be a constant value Standard 2022-10-10 14:21:28 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.credential.hmac_key_secret: object found, string expected, $.credential.hmac_key_access_id: object found, string expected 2022-10-10 14:21:28 INFO i.a.a.LoggingTrackingClient(track):43 - track. version: null, userId: null, action: Connector Jobs, metadata: {job_type=sync, config.destination.big_query_client_buffer_size_mb=set, namespace_definition=customformat, config.source.conversion_window_days=set, config.destination.dataset_location=US, frequency=manual, connector_source_definition_id=2a2552ca-9f78-4c1c-9eb7-4d0dc66d72df, workspace_id=12dbcf62-bf38-40be-8df2-287441f1b9c3, attempt_stage=STARTED, config.source.api_secret._secret=set, config.destination.project_id=set, attempt_id=2, connector_destination=BigQuery, catalog.sync_mode.incremental=set, connector_destination_docker_repository=airbyte/destination-bigquery, table_prefix=false, config.destination.credentials_json._secret=set, workspace_name=12dbcf62-bf38-40be-8df2-287441f1b9c3, config.source.start_date=set, number_of_streams=1, config.destination.dataset_id=set, catalog.destination_sync_mode.append_dedup=set, connector_source=WooCommerce, config.destination.transformation_priority=interactive, connector_source_docker_repository=airbyte/source-woocommerce, connection_id=944e156f-c3f8-49bd-81e0-ffc15e9e2f9f, job_id=14, connector_source_version=0.1.2, connector_destination_version=1.2.4, config.source.api_key._secret=set, operation.normalization=1, config.source.shop=set, operation_count=1, connector_destination_definition_id=22f6c74f-5699-40ff-833c-4a879ea40133} 2022-10-10 14:21:28 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/1/logs.log 2022-10-10 14:21:28 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:21:29 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:29 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-10 14:21:29 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:29 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-woocommerce:0.1.2 exists... 2022-10-10 14:21:29 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-woocommerce:0.1.2 was found locally. 2022-10-10 14:21:29 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-woocommerce-check-14-1-vzuza with resources io.airbyte.config.ResourceRequirements@10c87fd[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:29 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/1 --log-driver none --name source-woocommerce-check-14-1-vzuza --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-woocommerce:0.1.2 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/source-woocommerce:0.1.2 check --config source_config.json 2022-10-10 14:21:31 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-10 14:21:31 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:21:31 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:31 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-10 14:21:31 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:31 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/1/logs.log 2022-10-10 14:21:31 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:21:31 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:31 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-10 14:21:31 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:31 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-bigquery:1.2.4 exists... 2022-10-10 14:21:31 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-bigquery:1.2.4 was found locally. 2022-10-10 14:21:31 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-bigquery-check-14-1-advpm with resources io.airbyte.config.ResourceRequirements@10c87fd[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:31 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/1 --log-driver none --name destination-bigquery-check-14-1-advpm --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.2.4 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/destination-bigquery:1.2.4 check --config source_config.json 2022-10-10 14:21:33 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - integration args: {check=null, config=source_config.json} 2022-10-10 14:21:33 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:33 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Command: CHECK 2022-10-10 14:21:33 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-10 14:21:33 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:33 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:34 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Selected loading method is set to: GCS 2022-10-10 14:21:35 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - S3 format config: {"format_type":"CSV","flattening":"No flattening"} 2022-10-10 14:21:35 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Started testing if all required credentials assigned to user for single file uploading 2022-10-10 14:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Finished checking for normal upload mode 2022-10-10 14:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Started testing if all required credentials assigned to user for multipart upload 2022-10-10 14:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Initiated multipart upload to airbyte-preload-staging/airbyte-preload-staging/test_1665411696669 with full ID ABPnzm6ZX14XHVhGlfhjs9oGvmurB6m6tzw0lGxIi8yoNe3e5_aqfG-8kLyeT9_bLmktFvE 2022-10-10 14:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-10 14:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-10 14:21:36 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-10-10 14:21:36 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411696669 with id ABPnzm6ZX..._bLmktFvE]: Uploading leftover stream [Part number 1 containing 3.34 MB] 2022-10-10 14:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411696669 with id ABPnzm6ZX..._bLmktFvE]: Finished uploading [Part number 1 containing 3.34 MB] 2022-10-10 14:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411696669 with id ABPnzm6ZX..._bLmktFvE]: Completed 2022-10-10 14:21:37 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Finished verification for multipart upload mode 2022-10-10 14:21:38 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:38 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:38 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-10 14:21:38 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:38 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:21:39 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/1/logs.log 2022-10-10 14:21:39 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:21:39 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-10 14:21:39 INFO i.a.c.EnvConfigs(getEnvOrDefault):1072 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-10 14:21:39 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-10 14:21:39 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-10 14:21:39 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 14 attempt id: 1 2022-10-10 14:21:39 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.customers=incremental - append_dedup} 2022-10-10 14:21:39 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:39 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-10 14:21:39 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:39 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-10 14:21:39 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-bigquery:1.2.4 exists... 2022-10-10 14:21:39 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-bigquery:1.2.4 was found locally. 2022-10-10 14:21:39 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-bigquery-write-14-1-bofrs with resources io.airbyte.config.ResourceRequirements@7c735bc1[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:39 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/1 --log-driver none --name destination-bigquery-write-14-1-bofrs --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.2.4 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/destination-bigquery:1.2.4 write --config destination_config.json --catalog destination_catalog.json 2022-10-10 14:21:39 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-woocommerce:0.1.2 exists... 2022-10-10 14:21:39 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-woocommerce-read-14-1-kanpk with resources io.airbyte.config.ResourceRequirements@1bc88d6d[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:39 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/1 --log-driver none --name source-woocommerce-read-14-1-kanpk --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-woocommerce:0.1.2 -e WORKER_JOB_ATTEMPT=1 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/source-woocommerce:0.1.2 read --config source_config.json --catalog source_catalog.json 2022-10-10 14:21:39 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-woocommerce:0.1.2 was found locally. 2022-10-10 14:21:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-10 14:21:39 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-10 14:21:39 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-10 14:21:40 source > Starting syncing SourceWoocommerce 2022-10-10 14:21:40 source > Syncing stream: customers 2022-10-10 14:21:41 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-10 14:21:41 destination > Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:41 destination > Command: WRITE 2022-10-10 14:21:41 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-10 14:21:42 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:42 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:42 destination > Selected loading method is set to: GCS 2022-10-10 14:21:42 destination > S3 format config: {"format_type":"AVRO","flattening":"No flattening"} 2022-10-10 14:21:42 destination > All tmp files will be removed from GCS when replication is finished 2022-10-10 14:21:43 destination > Creating BigQuery staging message consumer with staging ID 9e729b67-97a9-4f1e-9656-c21782261467 at 2022-10-10T14:21:42.412Z 2022-10-10 14:21:43 destination > BigQuery write config: BigQueryWriteConfig[streamName=customers, namespace=raw_woo_commerce, datasetId=raw_woo_commerce, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_imo_customers}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]] 2022-10-10 14:21:43 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-10-10 14:21:43 destination > Preparing tmp tables in destination started for 1 streams 2022-10-10 14:21:43 destination > Creating dataset raw_woo_commerce 2022-10-10 14:21:44 destination > Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_imo_customers}} 2022-10-10 14:21:44 destination > Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_imo_customers}} 2022-10-10 14:21:44 destination > Creating staging path for stream customers (dataset raw_woo_commerce): airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/9e729b67-97a9-4f1e-9656-c21782261467/ 2022-10-10 14:21:44 destination > Storage Object airbyte-preload-staging/airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/9e729b67-97a9-4f1e-9656-c21782261467/ does not exist in bucket; creating... 2022-10-10 14:21:45 destination > Storage Object airbyte-preload-staging/airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/9e729b67-97a9-4f1e-9656-c21782261467/ has been created in bucket. 2022-10-10 14:21:45 destination > Preparing tmp tables in destination completed. 2022-10-10 14:21:46 source > using params: {'per_page': 100, 'after': DateTime(2022, 1, 1, 0, 0, 0), 'before': DateTime(2022, 10, 10, 14, 21, 40, 341300), 'orderby': 'registered_date', 'order': 'asc'} 2022-10-10 14:21:46 source > {"code":"woocommerce_rest_cannot_view","message":"Sorry, you cannot list resources.","data":{"status":401}} 2022-10-10 14:21:46 source > Encountered an exception while reading stream customers Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A40.341300&orderby=registered_date&order=asc 2022-10-10 14:21:46 source > Finished syncing customers 2022-10-10 14:21:46 source > SourceWoocommerce runtimes: Syncing stream customers 0:00:06.636886 2022-10-10 14:21:46 source > 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A40.341300&orderby=registered_date&order=asc Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A40.341300&orderby=registered_date&order=asc The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 127, in read raise AirbyteTracedException.from_exception(e, message=display_message) from e airbyte_cdk.utils.traced_exception.AirbyteTracedException: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A40.341300&orderby=registered_date&order=asc 2022-10-10 14:21:47 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-10 14:21:47 destination > Airbyte message consumer: succeeded. 2022-10-10 14:21:47 destination > executing on success close procedure. 2022-10-10 14:21:47 destination > Flushing all 0 current buffers (0 bytes in total) 2022-10-10 14:21:47 destination > Copying into tables in destination started for 1 streams 2022-10-10 14:21:47 destination > Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_imo_customers}} (dataset raw_woo_commerce): [] 2022-10-10 14:21:47 destination > Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_imo_customers}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}} (dataset raw_woo_commerce, sync mode append_dedup) 2022-10-10 14:21:51 destination > successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_imo_customers}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}} 2022-10-10 14:21:51 destination > Finalizing tables in destination completed 2022-10-10 14:21:51 destination > Cleaning up destination started for 1 streams 2022-10-10 14:21:51 destination > Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_imo_customers}} (dataset raw_woo_commerce) 2022-10-10 14:21:51 destination > Cleaning up staging path for stream customers (dataset raw_woo_commerce): airbyte-preload-staging/raw_woo_commerce_customers 2022-10-10 14:21:51 destination > Deleting object airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/9e729b67-97a9-4f1e-9656-c21782261467/ 2022-10-10 14:21:51 destination > Storage bucket airbyte-preload-staging/raw_woo_commerce_customers has been cleaned-up (1 objects were deleted)... 2022-10-10 14:21:51 destination > Cleaning up destination completed. 2022-10-10 14:21:51 destination > Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:51 ERROR i.a.w.g.DefaultReplicationWorker(run):188 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:181) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:68) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:145) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:68) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-10-10 14:21:51 INFO i.a.w.g.DefaultReplicationWorker(run):281 - Source did not output any state messages 2022-10-10 14:21:51 WARN i.a.w.g.DefaultReplicationWorker(run):292 - State capture: No state retained. 2022-10-10 14:21:51 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "failed", "recordsSynced" : 0, "bytesSynced" : 0, "startTime" : 1665411699217, "endTime" : 1665411711943, "totalStats" : { "recordsEmitted" : 0, "bytesEmitted" : 0, "sourceStateMessagesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "recordsCommitted" : 0, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0 }, "streamStats" : [ ] } 2022-10-10 14:21:51 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ { "failureOrigin" : "source", "failureType" : "system_error", "internalMessage" : "401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A40.341300&orderby=registered_date&order=asc", "externalMessage" : "Sorry, you cannot list resources.", "metadata" : { "attemptNumber" : 1, "jobId" : 14, "from_trace_message" : true, "connector_command" : "read" }, "stacktrace" : "Traceback (most recent call last):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 114, in read\n yield from self._read_stream(\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 179, in _read_stream\n for record in record_iterator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 241, in _read_incremental\n for record_counter, record_data in enumerate(records, start=1):\n File \"/airbyte/integration_code/source_woocommerce/source.py\", line 154, in read_records\n yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice)\n File \"/airbyte/integration_code/source_woocommerce/source.py\", line 135, in filter_records_newer_than_state\n for record in records_slice:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 421, in read_records\n response = self._send_request(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 339, in _send_request\n return backoff_handler(user_backoff_handler)(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 306, in _send\n raise exc\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 303, in _send\n response.raise_for_status()\n File \"/usr/local/lib/python3.9/site-packages/requests/models.py\", line 1021, in raise_for_status\n raise HTTPError(http_error_msg, response=self)\nrequests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A40.341300&orderby=registered_date&order=asc\n", "timestamp" : 1665411706978 }, { "failureOrigin" : "source", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!", "externalMessage" : "Something went wrong within the source connector", "metadata" : { "attemptNumber" : 1, "jobId" : 14, "connector_command" : "read" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:833)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\nCaused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357)\n\t... 4 more\n", "timestamp" : 1665411707134 } ] 2022-10-10 14:21:51 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:21:51 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:51 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-10 14:21:51 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:51 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):159 - sync summary: io.airbyte.config.StandardSyncOutput@a2cb64b[standardSyncSummary=io.airbyte.config.StandardSyncSummary@4f2e296a[status=failed,recordsSynced=0,bytesSynced=0,startTime=1665411699217,endTime=1665411711943,totalStats=io.airbyte.config.SyncStats@69b508b1[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@7eaba77d[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@11dad80d[stream=io.airbyte.protocol.models.AirbyteStream@2f01d625[name=customers,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"role":{"type":["null","string"]},"email":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"self":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}},"collection":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}}},"billing":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"email":{"type":["null","string"]},"phone":{"type":["null","string"]},"state":{"type":["null","string"]},"company":{"type":["null","string"]},"country":{"type":["null","string"]},"postcode":{"type":["null","string"]},"address_1":{"type":["null","string"]},"address_2":{"type":["null","string"]},"last_name":{"type":["null","string"]},"first_name":{"type":["null","string"]}}},"shipping":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"state":{"type":["null","string"]},"company":{"type":["null","string"]},"country":{"type":["null","string"]},"postcode":{"type":["null","string"]},"address_1":{"type":["null","string"]},"address_2":{"type":["null","string"]},"last_name":{"type":["null","string"]},"first_name":{"type":["null","string"]}}},"shop_url":{"type":["null","string"]},"username":{"type":["null","string"]},"last_name":{"type":["null","string"]},"meta_data":{"type":["null","array","object"],"oneOf":[{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"key":{"type":["null","string"]},"value":{"type":["null","object","string"]}}},{"type":"array","items":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"key":{"type":["null","string"]},"value":{"type":["null","object","string"]}}}}]},"avatar_url":{"type":["null","string"]},"first_name":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_modified":{"type":["null","string"],"format":"date-time"},"date_created_gmt":{"type":["null","string"],"format":"date-time"},"date_modified_gmt":{"type":["null","string"],"format":"date-time"},"is_paying_customer":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_created],sourceDefinedPrimaryKey=[[id]],namespace=raw_woo_commerce,additionalProperties={}],syncMode=incremental,cursorField=[date_created],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@6e30a3f4[failureOrigin=source,failureType=system_error,internalMessage=401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A40.341300&orderby=registered_date&order=asc,externalMessage=Sorry, you cannot list resources.,metadata=io.airbyte.config.Metadata@4d836100[additionalProperties={attemptNumber=1, jobId=14, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A21%3A40.341300&orderby=registered_date&order=asc ,retryable=,timestamp=1665411706978], io.airbyte.config.FailureReason@aded20d[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@2b4f8d8d[additionalProperties={attemptNumber=1, jobId=14, connector_command=read}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357) ... 4 more ,retryable=,timestamp=1665411707134]]] 2022-10-10 14:21:51 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-10 14:21:52 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.method: must be a constant value Standard 2022-10-10 14:21:52 INFO i.a.v.j.JsonSchemaValidator(test):71 - JSON schema validation failed. errors: $.credential.hmac_key_secret: object found, string expected, $.credential.hmac_key_access_id: object found, string expected 2022-10-10 14:21:52 INFO i.a.a.LoggingTrackingClient(track):43 - track. version: null, userId: null, action: Connector Jobs, metadata: {job_type=sync, config.destination.big_query_client_buffer_size_mb=set, namespace_definition=customformat, config.source.conversion_window_days=set, config.destination.dataset_location=US, frequency=manual, connector_source_definition_id=2a2552ca-9f78-4c1c-9eb7-4d0dc66d72df, workspace_id=12dbcf62-bf38-40be-8df2-287441f1b9c3, attempt_stage=STARTED, config.source.api_secret._secret=set, config.destination.project_id=set, attempt_id=3, connector_destination=BigQuery, catalog.sync_mode.incremental=set, connector_destination_docker_repository=airbyte/destination-bigquery, table_prefix=false, config.destination.credentials_json._secret=set, workspace_name=12dbcf62-bf38-40be-8df2-287441f1b9c3, config.source.start_date=set, number_of_streams=1, config.destination.dataset_id=set, catalog.destination_sync_mode.append_dedup=set, connector_source=WooCommerce, config.destination.transformation_priority=interactive, connector_source_docker_repository=airbyte/source-woocommerce, connection_id=944e156f-c3f8-49bd-81e0-ffc15e9e2f9f, job_id=14, connector_source_version=0.1.2, connector_destination_version=1.2.4, config.source.api_key._secret=set, operation.normalization=1, config.source.shop=set, operation_count=1, connector_destination_definition_id=22f6c74f-5699-40ff-833c-4a879ea40133} 2022-10-10 14:21:52 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/2/logs.log 2022-10-10 14:21:52 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:21:52 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:52 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-10 14:21:52 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:52 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-woocommerce:0.1.2 exists... 2022-10-10 14:21:52 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-woocommerce:0.1.2 was found locally. 2022-10-10 14:21:52 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-woocommerce-check-14-2-poqhg with resources io.airbyte.config.ResourceRequirements@10c87fd[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:52 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/2 --log-driver none --name source-woocommerce-check-14-2-poqhg --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-woocommerce:0.1.2 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/source-woocommerce:0.1.2 check --config source_config.json 2022-10-10 14:21:54 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Check succeeded 2022-10-10 14:21:54 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:21:54 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:54 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-10 14:21:54 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:54 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/2/logs.log 2022-10-10 14:21:54 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:21:54 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:54 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START CHECK ----- 2022-10-10 14:21:54 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:21:54 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-bigquery:1.2.4 exists... 2022-10-10 14:21:54 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-bigquery:1.2.4 was found locally. 2022-10-10 14:21:54 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-bigquery-check-14-2-ynnwx with resources io.airbyte.config.ResourceRequirements@10c87fd[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:21:54 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/2 --log-driver none --name destination-bigquery-check-14-2-ynnwx --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.2.4 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/destination-bigquery:1.2.4 check --config source_config.json 2022-10-10 14:21:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - integration args: {check=null, config=source_config.json} 2022-10-10 14:21:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:21:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Command: CHECK 2022-10-10 14:21:56 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'} 2022-10-10 14:21:56 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:56 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:21:57 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Selected loading method is set to: GCS 2022-10-10 14:21:58 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - S3 format config: {"format_type":"CSV","flattening":"No flattening"} 2022-10-10 14:21:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Started testing if all required credentials assigned to user for single file uploading 2022-10-10 14:21:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Finished checking for normal upload mode 2022-10-10 14:21:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Started testing if all required credentials assigned to user for multipart upload 2022-10-10 14:21:59 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Initiated multipart upload to airbyte-preload-staging/airbyte-preload-staging/test_1665411719706 with full ID ABPnzm7feg9ZI8AnoATm9wpo7XWIhBbsRMFErpUxMpNix02v6N6uuionWZ52cjVxr-wdK6M 2022-10-10 14:22:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-10 14:22:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Called close() on [MultipartOutputStream for parts 1 - 10000] 2022-10-10 14:22:00 WARN i.a.w.i.DefaultAirbyteStreamFactory(internalLog):100 - [MultipartOutputStream for parts 1 - 10000] is already closed 2022-10-10 14:22:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411719706 with id ABPnzm7fe...Vxr-wdK6M]: Uploading leftover stream [Part number 1 containing 3.34 MB] 2022-10-10 14:22:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411719706 with id ABPnzm7fe...Vxr-wdK6M]: Finished uploading [Part number 1 containing 3.34 MB] 2022-10-10 14:22:00 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - [Manager uploading to airbyte-preload-staging/airbyte-preload-staging/test_1665411719706 with id ABPnzm7fe...Vxr-wdK6M]: Completed 2022-10-10 14:22:01 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Finished verification for multipart upload mode 2022-10-10 14:22:01 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):103 - Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:22:01 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:22:01 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:22:01 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END CHECK ----- 2022-10-10 14:22:01 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:22:02 INFO i.a.w.t.TemporalAttemptExecution(get):108 - Docker volume job log path: /tmp/workspace/14/2/logs.log 2022-10-10 14:22:02 INFO i.a.w.t.TemporalAttemptExecution(get):113 - Executing worker wrapper. Airbyte version: 0.40.10 2022-10-10 14:22:02 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-10 14:22:02 INFO i.a.c.EnvConfigs(getEnvOrDefault):1072 - Using default value for environment variable METRIC_CLIENT: '' 2022-10-10 14:22:02 WARN i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to 2022-10-10 14:22:02 INFO i.a.c.f.EnvVariableFeatureFlags(getEnvOrDefault):55 - Using default value for environment variable LOG_CONNECTOR_MESSAGES: 'false' 2022-10-10 14:22:02 INFO i.a.w.g.DefaultReplicationWorker(run):122 - start sync worker. job id: 14 attempt id: 2 2022-10-10 14:22:02 INFO i.a.w.g.DefaultReplicationWorker(run):135 - configured sync modes: {null.customers=incremental - append_dedup} 2022-10-10 14:22:02 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:22:02 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- START REPLICATION ----- 2022-10-10 14:22:02 INFO i.a.w.i.DefaultAirbyteDestination(start):69 - Running destination... 2022-10-10 14:22:02 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:22:02 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/destination-bigquery:1.2.4 exists... 2022-10-10 14:22:02 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/destination-bigquery:1.2.4 was found locally. 2022-10-10 14:22:02 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = destination-bigquery-write-14-2-jnbjw with resources io.airbyte.config.ResourceRequirements@402b3843[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:22:02 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/2 --log-driver none --name destination-bigquery-write-14-2-jnbjw --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:1.2.4 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/destination-bigquery:1.2.4 write --config destination_config.json --catalog destination_catalog.json 2022-10-10 14:22:02 INFO i.a.c.i.LineGobbler(voidCall):114 - Checking if airbyte/source-woocommerce:0.1.2 exists... 2022-10-10 14:22:02 INFO i.a.c.i.LineGobbler(voidCall):114 - airbyte/source-woocommerce:0.1.2 was found locally. 2022-10-10 14:22:02 INFO i.a.w.p.DockerProcessFactory(create):119 - Creating docker container = source-woocommerce-read-14-2-dcxoj with resources io.airbyte.config.ResourceRequirements@1494281e[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] 2022-10-10 14:22:02 INFO i.a.w.p.DockerProcessFactory(create):163 - Preparing command: docker run --rm --init -i -w /data/14/2 --log-driver none --name source-woocommerce-read-14-2-dcxoj --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e USE_STREAM_CAPABLE_STATE=true -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e WORKER_CONNECTOR_IMAGE=airbyte/source-woocommerce:0.1.2 -e WORKER_JOB_ATTEMPT=2 -e AIRBYTE_VERSION=0.40.10 -e WORKER_JOB_ID=14 airbyte/source-woocommerce:0.1.2 read --config source_config.json --catalog source_catalog.json 2022-10-10 14:22:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$7):435 - Destination output thread started. 2022-10-10 14:22:02 INFO i.a.w.g.DefaultReplicationWorker(run):177 - Waiting for source and destination threads to complete. 2022-10-10 14:22:02 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):322 - Replication thread started. 2022-10-10 14:22:03 source > Starting syncing SourceWoocommerce 2022-10-10 14:22:03 source > Syncing stream: customers 2022-10-10 14:22:04 source > using params: {'per_page': 100, 'after': DateTime(2022, 1, 1, 0, 0, 0), 'before': DateTime(2022, 10, 10, 14, 22, 3, 300775), 'orderby': 'registered_date', 'order': 'asc'} 2022-10-10 14:22:04 source > {"code":"woocommerce_rest_cannot_view","message":"Sorry, you cannot list resources.","data":{"status":401}} 2022-10-10 14:22:04 source > Encountered an exception while reading stream customers Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A22%3A03.300775&orderby=registered_date&order=asc 2022-10-10 14:22:04 source > Finished syncing customers 2022-10-10 14:22:04 source > SourceWoocommerce runtimes: Syncing stream customers 0:00:00.735777 2022-10-10 14:22:04 source > 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A22%3A03.300775&orderby=registered_date&order=asc Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A22%3A03.300775&orderby=registered_date&order=asc The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 123, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 114, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 127, in read raise AirbyteTracedException.from_exception(e, message=display_message) from e airbyte_cdk.utils.traced_exception.AirbyteTracedException: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A22%3A03.300775&orderby=registered_date&order=asc 2022-10-10 14:22:04 INFO i.a.w.g.DefaultReplicationWorker(lambda$getReplicationRunnable$6):355 - Source has no more messages, closing connection. 2022-10-10 14:22:04 destination > integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-10-10 14:22:04 destination > Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:22:04 destination > Command: WRITE 2022-10-10 14:22:04 destination > Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-10-10 14:22:05 destination > Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:22:05 destination > Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-10-10 14:22:05 destination > Selected loading method is set to: GCS 2022-10-10 14:22:05 destination > S3 format config: {"format_type":"AVRO","flattening":"No flattening"} 2022-10-10 14:22:05 destination > All tmp files will be removed from GCS when replication is finished 2022-10-10 14:22:06 destination > Creating BigQuery staging message consumer with staging ID 9f2e1e6c-3b6d-498f-a953-4f1fe304d744 at 2022-10-10T14:22:05.485Z 2022-10-10 14:22:06 destination > BigQuery write config: BigQueryWriteConfig[streamName=customers, namespace=raw_woo_commerce, datasetId=raw_woo_commerce, datasetLocation=US, tmpTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_lhd_customers}}, targetTableId=GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}}, tableSchema=Schema{fields=[Field{name=_airbyte_ab_id, type=STRING, mode=null, description=null, policyTags=null}, Field{name=_airbyte_emitted_at, type=TIMESTAMP, mode=null, description=null, policyTags=null}, Field{name=_airbyte_data, type=STRING, mode=null, description=null, policyTags=null}]}, syncMode=append_dedup, stagedFiles=[]] 2022-10-10 14:22:06 destination > class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started. 2022-10-10 14:22:06 destination > Preparing tmp tables in destination started for 1 streams 2022-10-10 14:22:06 destination > Creating dataset raw_woo_commerce 2022-10-10 14:22:07 destination > Creating tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_lhd_customers}} 2022-10-10 14:22:07 destination > Partitioned table created successfully: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_lhd_customers}} 2022-10-10 14:22:07 destination > Creating staging path for stream customers (dataset raw_woo_commerce): airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/9f2e1e6c-3b6d-498f-a953-4f1fe304d744/ 2022-10-10 14:22:08 destination > Storage Object airbyte-preload-staging/airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/9f2e1e6c-3b6d-498f-a953-4f1fe304d744/ does not exist in bucket; creating... 2022-10-10 14:22:08 destination > Storage Object airbyte-preload-staging/airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/9f2e1e6c-3b6d-498f-a953-4f1fe304d744/ has been created in bucket. 2022-10-10 14:22:08 destination > Preparing tmp tables in destination completed. 2022-10-10 14:22:08 destination > Airbyte message consumer: succeeded. 2022-10-10 14:22:08 destination > executing on success close procedure. 2022-10-10 14:22:08 destination > Flushing all 0 current buffers (0 bytes in total) 2022-10-10 14:22:08 destination > Copying into tables in destination started for 1 streams 2022-10-10 14:22:08 destination > Uploading records from staging files to tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_lhd_customers}} (dataset raw_woo_commerce): [] 2022-10-10 14:22:08 destination > Copying data from tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_lhd_customers}} to target table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}} (dataset raw_woo_commerce, sync mode append_dedup) 2022-10-10 14:22:13 destination > successfully copied table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_lhd_customers}} to table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_raw_customers}} 2022-10-10 14:22:13 destination > Finalizing tables in destination completed 2022-10-10 14:22:13 destination > Cleaning up destination started for 1 streams 2022-10-10 14:22:13 destination > Deleting tmp table GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=raw_woo_commerce, tableId=_airbyte_tmp_lhd_customers}} (dataset raw_woo_commerce) 2022-10-10 14:22:13 destination > Cleaning up staging path for stream customers (dataset raw_woo_commerce): airbyte-preload-staging/raw_woo_commerce_customers 2022-10-10 14:22:13 destination > Deleting object airbyte-preload-staging/raw_woo_commerce_customers/2022/10/10/14/9f2e1e6c-3b6d-498f-a953-4f1fe304d744/ 2022-10-10 14:22:13 destination > Storage bucket airbyte-preload-staging/raw_woo_commerce_customers has been cleaned-up (1 objects were deleted)... 2022-10-10 14:22:13 destination > Cleaning up destination completed. 2022-10-10 14:22:13 destination > Completed integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-10-10 14:22:13 ERROR i.a.w.g.DefaultReplicationWorker(run):188 - Sync worker failed. java.util.concurrent.ExecutionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:181) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:68) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Suppressed: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:145) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:68) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:161) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.lang.Thread.run(Thread.java:833) ~[?:?] Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357) ~[io.airbyte-airbyte-workers-0.40.10.jar:?] at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?] ... 1 more 2022-10-10 14:22:13 INFO i.a.w.g.DefaultReplicationWorker(run):281 - Source did not output any state messages 2022-10-10 14:22:13 WARN i.a.w.g.DefaultReplicationWorker(run):292 - State capture: No state retained. 2022-10-10 14:22:13 INFO i.a.w.g.DefaultReplicationWorker(run):300 - sync summary: { "status" : "failed", "recordsSynced" : 0, "bytesSynced" : 0, "startTime" : 1665411722147, "endTime" : 1665411733837, "totalStats" : { "recordsEmitted" : 0, "bytesEmitted" : 0, "sourceStateMessagesEmitted" : 0, "destinationStateMessagesEmitted" : 0, "recordsCommitted" : 0, "meanSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBeforeSourceStateMessageEmitted" : 0, "maxSecondsBetweenStateMessageEmittedandCommitted" : 0, "meanSecondsBetweenStateMessageEmittedandCommitted" : 0 }, "streamStats" : [ ] } 2022-10-10 14:22:13 INFO i.a.w.g.DefaultReplicationWorker(run):301 - failures: [ { "failureOrigin" : "source", "failureType" : "system_error", "internalMessage" : "401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A22%3A03.300775&orderby=registered_date&order=asc", "externalMessage" : "Sorry, you cannot list resources.", "metadata" : { "attemptNumber" : 2, "jobId" : 14, "from_trace_message" : true, "connector_command" : "read" }, "stacktrace" : "Traceback (most recent call last):\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 114, in read\n yield from self._read_stream(\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 179, in _read_stream\n for record in record_iterator:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py\", line 241, in _read_incremental\n for record_counter, record_data in enumerate(records, start=1):\n File \"/airbyte/integration_code/source_woocommerce/source.py\", line 154, in read_records\n yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice)\n File \"/airbyte/integration_code/source_woocommerce/source.py\", line 135, in filter_records_newer_than_state\n for record in records_slice:\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 421, in read_records\n response = self._send_request(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 339, in _send_request\n return backoff_handler(user_backoff_handler)(request, request_kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/backoff/_sync.py\", line 105, in retry\n ret = target(*args, **kwargs)\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 306, in _send\n raise exc\n File \"/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 303, in _send\n response.raise_for_status()\n File \"/usr/local/lib/python3.9/site-packages/requests/models.py\", line 1021, in raise_for_status\n raise HTTPError(http_error_msg, response=self)\nrequests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A22%3A03.300775&orderby=registered_date&order=asc\n", "timestamp" : 1665411724039 }, { "failureOrigin" : "source", "internalMessage" : "io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!", "externalMessage" : "Something went wrong within the source connector", "metadata" : { "attemptNumber" : 2, "jobId" : 14, "connector_command" : "read" }, "stacktrace" : "java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!\n\tat java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)\n\tat java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)\n\tat java.base/java.lang.Thread.run(Thread.java:833)\nCaused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\t... 3 more\nCaused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled.\n\tat io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140)\n\tat io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357)\n\t... 4 more\n", "timestamp" : 1665411724278 } ] 2022-10-10 14:22:13 INFO i.a.w.t.TemporalAttemptExecution(get):134 - Stopping cancellation check scheduling... 2022-10-10 14:22:13 INFO i.a.w.t.s.ReplicationActivityImpl(lambda$replicate$3):159 - sync summary: io.airbyte.config.StandardSyncOutput@2348bc49[standardSyncSummary=io.airbyte.config.StandardSyncSummary@664a3644[status=failed,recordsSynced=0,bytesSynced=0,startTime=1665411722147,endTime=1665411733837,totalStats=io.airbyte.config.SyncStats@496c2cab[recordsEmitted=0,bytesEmitted=0,sourceStateMessagesEmitted=0,destinationStateMessagesEmitted=0,recordsCommitted=0,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,additionalProperties={}],streamStats=[]],normalizationSummary=,state=,outputCatalog=io.airbyte.protocol.models.ConfiguredAirbyteCatalog@5766753d[streams=[io.airbyte.protocol.models.ConfiguredAirbyteStream@31aa316c[stream=io.airbyte.protocol.models.AirbyteStream@665c90b[name=customers,jsonSchema={"type":"object","$schema":"http://json-schema.org/draft-07/schema#","properties":{"id":{"type":["null","integer"]},"role":{"type":["null","string"]},"email":{"type":["null","string"]},"_links":{"type":["null","object"],"properties":{"self":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}},"collection":{"type":["null","array"],"items":{"type":["null","object"],"properties":{"href":{"type":["null","string"]}}}}}},"billing":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"email":{"type":["null","string"]},"phone":{"type":["null","string"]},"state":{"type":["null","string"]},"company":{"type":["null","string"]},"country":{"type":["null","string"]},"postcode":{"type":["null","string"]},"address_1":{"type":["null","string"]},"address_2":{"type":["null","string"]},"last_name":{"type":["null","string"]},"first_name":{"type":["null","string"]}}},"shipping":{"type":["null","object"],"properties":{"city":{"type":["null","string"]},"state":{"type":["null","string"]},"company":{"type":["null","string"]},"country":{"type":["null","string"]},"postcode":{"type":["null","string"]},"address_1":{"type":["null","string"]},"address_2":{"type":["null","string"]},"last_name":{"type":["null","string"]},"first_name":{"type":["null","string"]}}},"shop_url":{"type":["null","string"]},"username":{"type":["null","string"]},"last_name":{"type":["null","string"]},"meta_data":{"type":["null","array","object"],"oneOf":[{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"key":{"type":["null","string"]},"value":{"type":["null","object","string"]}}},{"type":"array","items":{"type":["null","object"],"properties":{"id":{"type":["null","integer"]},"key":{"type":["null","string"]},"value":{"type":["null","object","string"]}}}}]},"avatar_url":{"type":["null","string"]},"first_name":{"type":["null","string"]},"date_created":{"type":["null","string"],"format":"date-time"},"date_modified":{"type":["null","string"],"format":"date-time"},"date_created_gmt":{"type":["null","string"],"format":"date-time"},"date_modified_gmt":{"type":["null","string"],"format":"date-time"},"is_paying_customer":{"type":["null","boolean"]}}},supportedSyncModes=[full_refresh, incremental],sourceDefinedCursor=true,defaultCursorField=[date_created],sourceDefinedPrimaryKey=[[id]],namespace=raw_woo_commerce,additionalProperties={}],syncMode=incremental,cursorField=[date_created],destinationSyncMode=append_dedup,primaryKey=[[id]],additionalProperties={}]],additionalProperties={}],failures=[io.airbyte.config.FailureReason@2e44a418[failureOrigin=source,failureType=system_error,internalMessage=401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A22%3A03.300775&orderby=registered_date&order=asc,externalMessage=Sorry, you cannot list resources.,metadata=io.airbyte.config.Metadata@4a6fe370[additionalProperties={attemptNumber=2, jobId=14, from_trace_message=true, connector_command=read}],stacktrace=Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 179, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 241, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/airbyte/integration_code/source_woocommerce/source.py", line 154, in read_records yield from self.filter_records_newer_than_state(stream_state=stream_state, records_slice=records_slice) File "/airbyte/integration_code/source_woocommerce/source.py", line 135, in filter_records_newer_than_state for record in records_slice: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 421, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 339, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 105, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 306, in _send raise exc File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 303, in _send response.raise_for_status() File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 1021, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 401 Client Error: Unauthorized for url: https://www.ilnp.com/wp-json/wc/v3/customers?per_page=100&after=2022-01-01T00%3A00%3A00&before=2022-10-10T14%3A22%3A03.300775&orderby=registered_date&order=asc ,retryable=,timestamp=1665411724039], io.airbyte.config.FailureReason@2aae9a00[failureOrigin=source,failureType=,internalMessage=io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped!,externalMessage=Something went wrong within the source connector,metadata=io.airbyte.config.Metadata@22b33cf[additionalProperties={attemptNumber=2, jobId=14, connector_command=read}],stacktrace=java.util.concurrent.CompletionException: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315) at java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1807) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) at java.base/java.lang.Thread.run(Thread.java:833) Caused by: io.airbyte.workers.general.DefaultReplicationWorker$SourceException: Source cannot be stopped! at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:359) at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ... 3 more Caused by: io.airbyte.workers.exception.WorkerException: Source process exit with code 1. This warning is normal if the job was cancelled. at io.airbyte.workers.internal.DefaultAirbyteSource.close(DefaultAirbyteSource.java:140) at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:357) ... 4 more ,retryable=,timestamp=1665411724278]]] 2022-10-10 14:22:13 INFO i.a.c.t.TemporalUtils(withBackgroundHeartbeat):280 - Stopping temporal heartbeating... 2022-10-10 14:22:13 INFO i.a.c.i.LineGobbler(voidCall):114 - 2022-10-10 14:22:13 INFO i.a.c.i.LineGobbler(voidCall):114 - ----- END REPLICATION ----- 2022-10-10 14:22:13 INFO i.a.c.i.LineGobbler(voidCall):114 -