2022-05-26 12:54:23 INFO i.a.w.WorkerApp(main):311 - workspaceRoot = /workspace 2022-05-26 12:54:25 INFO i.a.w.WorkerApp(main):314 - temporalHost = airbyte-temporal:7233 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable SECRET_PERSISTENCE: 'NONE' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.1-r1' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-05-26 12:54:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.77.0' 2022-05-26 12:54:29 INFO i.a.w.WorkerApp(getJobProcessFactory):264 - Using Kubernetes namespace: apps Cannot start publish with com.van.logging.aws.S3PublishHelper@7a395b8 due to error: Cannot start publishing: Unable to execute HTTP request: Connect to airbyte-minio:9000 [airbyte-minio/172.20.237.54] failed: Connection refused 2022-05-26 12:54:32 INFO i.t.s.WorkflowServiceStubsImpl():184 - Created GRPC client for channel: ManagedChannelOrphanWrapper{delegate=ManagedChannelImpl{logId=1, target=airbyte-temporal:7233}} 2022-05-26 12:54:32 INFO i.a.w.t.TemporalUtils(waitForTemporalServerAndLog):125 - Waiting for temporal server... 2022-05-26 12:54:32 WARN i.a.w.t.TemporalUtils(waitForTemporalServerAndLog):130 - Waiting for default namespace to be initialized in temporal... Cannot end publish with com.van.logging.aws.S3PublishHelper@7a395b8 due to error: Cannot end publishing: Cannot publish to S3: Unable to execute HTTP request: Connect to airbyte-minio:9000 [airbyte-minio/172.20.237.54] failed: Connection refused 2022-05-26 12:54:39 INFO i.a.w.t.TemporalUtils(waitForTemporalServerAndLog):144 - Found temporal default namespace! 2022-05-26 12:54:39 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable CONFIG_DATABASE_USER: 'airbyte' 2022-05-26 12:54:39 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable CONFIG_DATABASE_PASSWORD: '*****' 2022-05-26 12:54:39 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable CONFIG_DATABASE_URL: 'jdbc:postgresql://airbyte-postgresql:5432/db-airbyte' 2022-05-26 12:54:39 WARN i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):65 - Waiting for database to become available... 2022-05-26 12:54:39 INFO i.a.d.i.c.ConfigsDatabaseInstance(lambda$static$3):27 - Testing if airbyte_configs has been created and seeded... 2022-05-26 12:54:41 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):90 - Database available! 2022-05-26 12:54:41 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):48 - Database available! 2022-05-26 12:54:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable SECRET_PERSISTENCE: 'NONE' 2022-05-26 12:54:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable SECRET_PERSISTENCE: 'NONE' 2022-05-26 12:54:41 WARN i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):65 - Waiting for database to become available... 2022-05-26 12:54:41 INFO i.a.d.i.j.JobsDatabaseInstance(lambda$static$2):25 - Testing if jobs database is ready... 2022-05-26 12:54:41 INFO i.a.d.Databases(createPostgresDatabaseWithRetryTimeout):90 - Database available! 2022-05-26 12:54:41 INFO i.a.d.Databases(createPostgresDatabaseWithRetry):48 - Database available! 2022-05-26 12:54:41 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable DEPLOYMENT_MODE: 'OSS' 2022-05-26 12:54:42 INFO i.t.s.WorkflowServiceStubsImpl():184 - Created GRPC client for channel: ManagedChannelOrphanWrapper{delegate=ManagedChannelImpl{logId=5, target=airbyte-temporal:7233}} 2022-05-26 12:54:42 INFO i.a.w.t.TemporalUtils(waitForTemporalServerAndLog):125 - Waiting for temporal server... 2022-05-26 12:54:42 WARN i.a.w.t.TemporalUtils(waitForTemporalServerAndLog):130 - Waiting for default namespace to be initialized in temporal... 2022-05-26 12:54:49 INFO i.a.w.t.TemporalUtils(waitForTemporalServerAndLog):144 - Found temporal default namespace! 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_MAIN_CONTAINER_CPU_REQUEST: 'null' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_MAIN_CONTAINER_CPU_LIMIT: 'null' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_REQUEST: 'null' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_MAIN_CONTAINER_MEMORY_LIMIT: 'null' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_TOLERATIONS: '' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_NODE_SELECTORS: '' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_SECRET: '' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_MAIN_CONTAINER_IMAGE_PULL_POLICY: 'IfNotPresent' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_SOCAT_IMAGE: 'alpine/socat:1.7.4.1-r1' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_BUSYBOX_IMAGE: 'busybox:1.28' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable JOB_KUBE_CURL_IMAGE: 'curlimages/curl:7.77.0' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable CONTAINER_ORCHESTRATOR_ENABLED: 'false' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable MAX_SPEC_WORKERS: '5' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable MAX_CHECK_WORKERS: '5' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable MAX_DISCOVER_WORKERS: '5' 2022-05-26 12:54:49 INFO i.a.c.EnvConfigs(getEnvOrDefault):596 - Using default value for environment variable MAX_SYNC_WORKERS: '5' 2022-05-26 12:54:49 INFO o.e.j.u.l.Log(initialized):169 - Logging initialized @27592ms to org.eclipse.jetty.util.log.Slf4jLog 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=2, pollThreadNamePrefix='Workflow Poller taskQueue="DISCOVER_SCHEMA", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=1, pollThreadNamePrefix='Local Activity Poller taskQueue="DISCOVER_SCHEMA", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=5, pollThreadNamePrefix='Activity Poller taskQueue="DISCOVER_SCHEMA", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=2, pollThreadNamePrefix='Workflow Poller taskQueue="CONNECTION_UPDATER", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO o.e.j.s.Server(doStart):360 - jetty-9.4.31.v20200723; built: 2020-07-23T17:57:36.812Z; git: 450ba27947e13e66baa8cd1ce7e85a4461cacc1d; jvm 17.0.1+12-39 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=1, pollThreadNamePrefix='Local Activity Poller taskQueue="CONNECTION_UPDATER", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=5, pollThreadNamePrefix='Activity Poller taskQueue="CONNECTION_UPDATER", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=2, pollThreadNamePrefix='Workflow Poller taskQueue="CHECK_CONNECTION", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=1, pollThreadNamePrefix='Local Activity Poller taskQueue="CHECK_CONNECTION", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=5, pollThreadNamePrefix='Activity Poller taskQueue="CHECK_CONNECTION", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=2, pollThreadNamePrefix='Workflow Poller taskQueue="SYNC", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=1, pollThreadNamePrefix='Local Activity Poller taskQueue="SYNC", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=5, pollThreadNamePrefix='Activity Poller taskQueue="SYNC", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=2, pollThreadNamePrefix='Workflow Poller taskQueue="GET_SPEC", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=1, pollThreadNamePrefix='Local Activity Poller taskQueue="GET_SPEC", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=5, pollThreadNamePrefix='Activity Poller taskQueue="GET_SPEC", namespace="default"'}, identity=1@airbyte-worker-76dd6c68f4-h6p7l} 2022-05-26 12:54:49 INFO o.e.j.s.h.ContextHandler(doStart):860 - Started o.e.j.s.ServletContextHandler@52b858c9{/,null,AVAILABLE} 2022-05-26 12:54:49 INFO i.t.i.w.Poller(start):95 - start(): Poller{options=PollerOptions{maximumPollRateIntervalMilliseconds=1000, maximumPollRatePerSecond=0.0, pollBackoffCoefficient=2.0, pollBackoffInitialInterval=PT0.1S, pollBackoffMaximumInterval=PT1M, pollThreadCount=5, pollThreadNamePrefix='Host Local Workflow Poller'}, identity=97516124-b015-4101-aba1-29b743753111} 2022-05-26 12:54:49 INFO o.e.j.s.AbstractConnector(doStart):331 - Started ServerConnector@6526d856{HTTP/1.1, (http/1.1)}{0.0.0.0:9000} 2022-05-26 12:54:49 INFO o.e.j.s.Server(doStart):400 - Started @27912ms 2022-05-26 15:12:14 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/b185c978-04c8-4175-85bb-c060c2242bb6/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/b185c978-04c8-4175-85bb-c060c2242bb6/0/logs.log in region null; compressed: false) 2022-05-26 15:12:14 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished12620009329997670103.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b185c978-04c8-4175-85bb-c060c2242bb6/0/logs.log/20220526151214_airbyte-worker-76dd6c68f4-h6p7l_8b28ad3bd2a94c7cb7c2c13f403c5675): 2022-05-26 15:12:14 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu 2022-05-26 15:12:14 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu stdoutLocalPort = 9024 2022-05-26 15:12:14 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu stderrLocalPort = 9025 2022-05-26 15:12:14 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 15:12:14 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 15:12:14 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 15:12:15 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 15:12:15 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/3dbe7bda-df8f-420e-b477-526ef1f7136c/source_config.json apps/source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu:/config/source_config.json -c init 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/520cdbb7-7854-473f-809a-b4ad276aa23b/FINISHED_UPLOADING apps/source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu:/config/FINISHED_UPLOADING -c init 2022-05-26 15:12:18 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 15:12:19 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):306 - Waiting for init container to terminate before checking exit value... 2022-05-26 15:12:19 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):311 - Init container terminated with exit value 0. 2022-05-26 15:12:19 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-05-26 15:12:19 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 15:12:19 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 15:12:28 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 15:12:28 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 15:12:31 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 15:12:31 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.110.22 2022-05-26 15:12:31 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... Collecting content into /tmp/toBePublished9327611930456346029.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b185c978-04c8-4175-85bb-c060c2242bb6/0/logs.log/20220526151314_airbyte-worker-76dd6c68f4-h6p7l_8b28ad3bd2a94c7cb7c2c13f403c5675): 2022-05-26 15:26:58 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/4f8e32c9-2721-485a-969c-f4d2ab044e84/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/4f8e32c9-2721-485a-969c-f4d2ab044e84/0/logs.log in region null; compressed: false) 2022-05-26 15:26:58 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished14404660109837816863.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/4f8e32c9-2721-485a-969c-f4d2ab044e84/0/logs.log/20220526152658_airbyte-worker-76dd6c68f4-h6p7l_7d8c7a977fae4e05be000802b9c92151): 2022-05-26 15:26:58 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq 2022-05-26 15:26:58 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq stdoutLocalPort = 9026 2022-05-26 15:26:58 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq stderrLocalPort = 9027 2022-05-26 15:26:58 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 15:26:58 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 15:26:58 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 15:26:58 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 15:26:58 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/93d6ac92-7db5-4f4a-8c86-543411076a04/source_config.json apps/source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq:/config/source_config.json -c init 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/f41d5561-64dd-477d-95b1-68e5120fb6b6/FINISHED_UPLOADING apps/source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq:/config/FINISHED_UPLOADING -c init 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 15:27:02 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 15:27:11 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 15:27:11 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 15:27:14 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 15:27:14 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.145.210 2022-05-26 15:27:14 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... 2022-05-26 15:27:47 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3/0/logs.log in region null; compressed: false) 2022-05-26 15:27:47 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished11596314092801255371.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3/0/logs.log/20220526152747_airbyte-worker-76dd6c68f4-h6p7l_d7815710f5bf484a9b243b092be359e8): 2022-05-26 15:27:47 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy 2022-05-26 15:27:47 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy stdoutLocalPort = 9028 2022-05-26 15:27:47 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy stderrLocalPort = 9029 2022-05-26 15:27:47 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 15:27:47 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 15:27:47 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 15:27:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 15:27:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/14f06c1d-215f-422f-9bd2-fb961ac7220e/source_config.json apps/source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy:/config/source_config.json -c init 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/df86d48c-d6c0-4dc7-88b1-27cf347b956d/FINISHED_UPLOADING apps/source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy:/config/FINISHED_UPLOADING -c init 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 15:27:48 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 15:27:49 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 15:27:49 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 15:27:50 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 15:27:50 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.159.21 2022-05-26 15:27:50 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... Collecting content into /tmp/toBePublished5127475770015734757.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/4f8e32c9-2721-485a-969c-f4d2ab044e84/0/logs.log/20220526152758_airbyte-worker-76dd6c68f4-h6p7l_7d8c7a977fae4e05be000802b9c92151): Collecting content into /tmp/toBePublished17039738031399613016.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3/0/logs.log/20220526152847_airbyte-worker-76dd6c68f4-h6p7l_d7815710f5bf484a9b243b092be359e8): 2022-05-26 15:33:44 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/74f13075-8581-4de3-bee9-141f50c08d75/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/74f13075-8581-4de3-bee9-141f50c08d75/0/logs.log in region null; compressed: false) 2022-05-26 15:33:44 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished8799122321018237895.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/74f13075-8581-4de3-bee9-141f50c08d75/0/logs.log/20220526153344_airbyte-worker-76dd6c68f4-h6p7l_d7c31c14c9ff4bfa9b7c0be31ccfda1f): 2022-05-26 15:33:44 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe 2022-05-26 15:33:44 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe stdoutLocalPort = 9030 2022-05-26 15:33:44 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe stderrLocalPort = 9031 2022-05-26 15:33:44 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 15:33:44 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 15:33:44 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 15:33:44 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 15:33:44 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/c69eca67-b9d9-492a-b635-83e5c8f75def/source_config.json apps/source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe:/config/source_config.json -c init 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/2985ac51-e370-4e28-8e2d-701e0ce8d411/FINISHED_UPLOADING apps/source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe:/config/FINISHED_UPLOADING -c init 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 15:33:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):306 - Waiting for init container to terminate before checking exit value... 2022-05-26 15:33:48 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):311 - Init container terminated with exit value 0. 2022-05-26 15:33:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-05-26 15:33:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 15:33:48 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 15:33:56 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 15:33:56 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 15:34:00 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 15:34:00 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.97.145 2022-05-26 15:34:00 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... Collecting content into /tmp/toBePublished6760153102592096860.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/74f13075-8581-4de3-bee9-141f50c08d75/0/logs.log/20220526153444_airbyte-worker-76dd6c68f4-h6p7l_d7c31c14c9ff4bfa9b7c0be31ccfda1f): 2022-05-26 16:04:45 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/b9d58b0f-035c-40f3-8495-5f8f976a6b88/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/b9d58b0f-035c-40f3-8495-5f8f976a6b88/0/logs.log in region null; compressed: false) 2022-05-26 16:04:45 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished7193478316604004308.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b9d58b0f-035c-40f3-8495-5f8f976a6b88/0/logs.log/20220526160445_airbyte-worker-76dd6c68f4-h6p7l_d04bffab90dd491580cd025d90d857b0): 2022-05-26 16:04:45 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva 2022-05-26 16:04:45 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva stdoutLocalPort = 9032 2022-05-26 16:04:45 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva stderrLocalPort = 9033 2022-05-26 16:04:45 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 16:04:45 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 16:04:45 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 16:04:45 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 16:04:46 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 16:04:46 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 16:04:46 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 16:04:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 16:04:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/7c542445-181b-48b2-9be3-144c13b9acd0/source_config.json apps/source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva:/config/source_config.json -c init 2022-05-26 16:04:46 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/de127388-b0c2-4466-a57c-29a35bda5a01/FINISHED_UPLOADING apps/source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva:/config/FINISHED_UPLOADING -c init 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):306 - Waiting for init container to terminate before checking exit value... 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):311 - Init container terminated with exit value 0. 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:04:47 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 16:04:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 16:04:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 16:04:48 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 16:04:48 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.159.230 2022-05-26 16:04:48 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... Collecting content into /tmp/toBePublished11474285295902980888.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b9d58b0f-035c-40f3-8495-5f8f976a6b88/0/logs.log/20220526160545_airbyte-worker-76dd6c68f4-h6p7l_d04bffab90dd491580cd025d90d857b0): 2022-05-26 16:12:14 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=2253b81e-9e89-4c50-9fff-b15d314f688a, RunId=0df5308b-fe8e-453c-8fb6-47601071af92, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='ee6c576f-4fd0-3134-b7bd-b1a6ddb7ed17', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 16:12:14 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/b185c978-04c8-4175-85bb-c060c2242bb6/0/logs.log in region null; compressed: false) 2022-05-26 16:12:14 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu Collecting content into /tmp/toBePublished6294414434947189769.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b185c978-04c8-4175-85bb-c060c2242bb6/0/logs.log/20220526161214_airbyte-worker-76dd6c68f4-h6p7l_a4e09b1b6447424a8b0a3340d9438c70): 2022-05-26 16:12:14 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 16:12:14 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 16:12:14 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 16:12:14 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=ee6c576f-4fd0-3134-b7bd-b1a6ddb7ed17, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 16:12:14 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu 2022-05-26 16:12:14 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/84e45599-ae75-41c1-a228-008e501aacbd/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/84e45599-ae75-41c1-a228-008e501aacbd/0/logs.log in region null; compressed: false) 2022-05-26 16:12:14 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished13723162595822339037.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/84e45599-ae75-41c1-a228-008e501aacbd/0/logs.log/20220526161214_airbyte-worker-76dd6c68f4-h6p7l_747bfa242e934f799a6e7cc66042d758): 2022-05-26 16:12:15 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb 2022-05-26 16:12:15 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb stdoutLocalPort = 9034 2022-05-26 16:12:15 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb stderrLocalPort = 9035 2022-05-26 16:12:15 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 16:12:15 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 16:12:15 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 16:12:15 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 16:12:15 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/11a7ee52-7bf3-416c-a0cb-a685eff39a12/source_config.json apps/source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb:/config/source_config.json -c init 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/7964733f-0d46-45cb-9340-33f503f5f169/FINISHED_UPLOADING apps/source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb:/config/FINISHED_UPLOADING -c init 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:12:16 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):306 - Waiting for init container to terminate before checking exit value... 2022-05-26 16:12:17 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):311 - Init container terminated with exit value 0. 2022-05-26 16:12:17 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-05-26 16:12:17 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:12:17 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 16:12:17 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 16:12:17 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 16:12:18 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 16:12:18 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.109.46 2022-05-26 16:12:18 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... 2022-05-26 16:12:24 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 16:12:24 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu 2022-05-26 16:12:24 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-b185c978-04c8-4175-85bb-c060c2242bb6-0-wylfu 2022-05-26 16:12:24 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 16:12:24 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 16:12:24 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. Collecting content into /tmp/toBePublished9485821768660707321.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b185c978-04c8-4175-85bb-c060c2242bb6/0/logs.log/20220526161314_airbyte-worker-76dd6c68f4-h6p7l_a4e09b1b6447424a8b0a3340d9438c70): Collecting content into /tmp/toBePublished15174076915397285274.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/84e45599-ae75-41c1-a228-008e501aacbd/0/logs.log/20220526161314_airbyte-worker-76dd6c68f4-h6p7l_747bfa242e934f799a6e7cc66042d758): 2022-05-26 16:26:58 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=9c36e1bc-b9eb-4ddc-bb7d-e673a5aa8d81, RunId=d27f6e92-d2a1-472d-ab5a-e638d319eeff, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='a43d9614-2c04-3030-a2b7-d90e3fd9f84c', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 16:26:58 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/4f8e32c9-2721-485a-969c-f4d2ab044e84/0/logs.log in region null; compressed: false) 2022-05-26 16:26:58 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq Collecting content into /tmp/toBePublished14740426306134652060.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/4f8e32c9-2721-485a-969c-f4d2ab044e84/0/logs.log/20220526162658_airbyte-worker-76dd6c68f4-h6p7l_549ba1ebdccc461199d79a49ac53a301): 2022-05-26 16:26:58 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq 2022-05-26 16:26:58 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 16:26:58 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 16:26:58 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 16:26:58 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=a43d9614-2c04-3030-a2b7-d90e3fd9f84c, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 16:26:58 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d/0/logs.log in region null; compressed: false) 2022-05-26 16:26:58 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished5409596980258754639.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d/0/logs.log/20220526162658_airbyte-worker-76dd6c68f4-h6p7l_f8554d47ade646168c5bad965565219a): 2022-05-26 16:26:58 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma 2022-05-26 16:26:58 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma stdoutLocalPort = 9036 2022-05-26 16:26:58 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma stderrLocalPort = 9037 2022-05-26 16:26:58 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 16:26:58 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 16:26:58 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 16:26:58 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 16:26:58 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/0f82d55b-2134-4b07-b98a-09aef4edc109/source_config.json apps/source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma:/config/source_config.json -c init 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/a843d185-ce39-44fd-aadb-55c98982dc43/FINISHED_UPLOADING apps/source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma:/config/FINISHED_UPLOADING -c init 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:26:59 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):306 - Waiting for init container to terminate before checking exit value... 2022-05-26 16:27:00 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):311 - Init container terminated with exit value 0. 2022-05-26 16:27:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-05-26 16:27:00 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:27:00 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 16:27:00 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 16:27:00 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 16:27:01 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 16:27:01 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.124.137 2022-05-26 16:27:01 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... 2022-05-26 16:27:08 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 16:27:08 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq 2022-05-26 16:27:08 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-4f8e32c9-2721-485a-969c-f4d2ab044e84-0-abnkq 2022-05-26 16:27:08 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 16:27:08 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 16:27:08 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. 2022-05-26 16:27:47 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=b1f64ba9-c892-4f2a-b68b-83f823f6558a, RunId=7c58ac69-281a-4083-aafc-0d6b473267e9, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='a55662f5-ae6c-3191-9ae6-9a7274732121', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 16:27:47 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3/0/logs.log in region null; compressed: false) 2022-05-26 16:27:47 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy Collecting content into /tmp/toBePublished15483344099339616231.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3/0/logs.log/20220526162747_airbyte-worker-76dd6c68f4-h6p7l_3a94b485ee134b99a6530b8232303eee): 2022-05-26 16:27:47 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 16:27:47 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy 2022-05-26 16:27:47 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 16:27:47 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 16:27:47 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=a55662f5-ae6c-3191-9ae6-9a7274732121, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 16:27:47 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/c1d775d3-2a78-446c-9258-a3a11316bfa8/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/c1d775d3-2a78-446c-9258-a3a11316bfa8/0/logs.log in region null; compressed: false) 2022-05-26 16:27:47 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished210676705934733419.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/c1d775d3-2a78-446c-9258-a3a11316bfa8/0/logs.log/20220526162747_airbyte-worker-76dd6c68f4-h6p7l_6a73015aed534179a436dda029e8fe96): 2022-05-26 16:27:47 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj 2022-05-26 16:27:47 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj stdoutLocalPort = 9038 2022-05-26 16:27:47 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj stderrLocalPort = 9039 2022-05-26 16:27:47 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 16:27:47 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 16:27:47 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 16:27:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 16:27:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/f301723f-e82c-4aaf-b40c-4abbac063155/source_config.json apps/source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj:/config/source_config.json -c init 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/638d168c-9349-4e38-866d-f622f7ac289b/FINISHED_UPLOADING apps/source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj:/config/FINISHED_UPLOADING -c init 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:27:49 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 16:27:50 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 16:27:50 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 16:27:51 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 16:27:51 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.144.242 2022-05-26 16:27:51 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... 2022-05-26 16:27:57 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 16:27:57 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy 2022-05-26 16:27:57 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3-0-hafjy 2022-05-26 16:27:57 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 16:27:57 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 16:27:57 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. Collecting content into /tmp/toBePublished6042026991358428561.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/4f8e32c9-2721-485a-969c-f4d2ab044e84/0/logs.log/20220526162758_airbyte-worker-76dd6c68f4-h6p7l_549ba1ebdccc461199d79a49ac53a301): Collecting content into /tmp/toBePublished4172000736126986580.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d/0/logs.log/20220526162758_airbyte-worker-76dd6c68f4-h6p7l_f8554d47ade646168c5bad965565219a): Collecting content into /tmp/toBePublished17104263006122452430.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/d8e7baec-9978-4bc3-a01f-f0b69bc5c8a3/0/logs.log/20220526162847_airbyte-worker-76dd6c68f4-h6p7l_3a94b485ee134b99a6530b8232303eee): Collecting content into /tmp/toBePublished10380313434524090814.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/c1d775d3-2a78-446c-9258-a3a11316bfa8/0/logs.log/20220526162847_airbyte-worker-76dd6c68f4-h6p7l_6a73015aed534179a436dda029e8fe96): 2022-05-26 16:33:44 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=fe3cc841-03c4-4985-be83-21703f555791, RunId=dc3c99d7-6817-44b8-b66d-39e8bc3c00c7, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='77bc3830-c68c-329a-a944-f23a0a65fde7', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 16:33:44 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/74f13075-8581-4de3-bee9-141f50c08d75/0/logs.log in region null; compressed: false) 2022-05-26 16:33:44 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe Collecting content into /tmp/toBePublished13492820264114987121.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/74f13075-8581-4de3-bee9-141f50c08d75/0/logs.log/20220526163344_airbyte-worker-76dd6c68f4-h6p7l_c24eafa86e794f92bc1f482746227f67): 2022-05-26 16:33:44 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe 2022-05-26 16:33:44 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 16:33:44 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 16:33:44 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 16:33:44 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=77bc3830-c68c-329a-a944-f23a0a65fde7, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 16:33:54 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 16:33:54 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe 2022-05-26 16:33:54 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-74f13075-8581-4de3-bee9-141f50c08d75-0-ctipe 2022-05-26 16:33:54 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 16:33:54 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 16:33:54 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. 2022-05-26 16:34:40 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/02ca716b-2b21-4eab-9912-2aefc8c58215/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/02ca716b-2b21-4eab-9912-2aefc8c58215/0/logs.log in region null; compressed: false) 2022-05-26 16:34:40 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished4668415434334190015.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/02ca716b-2b21-4eab-9912-2aefc8c58215/0/logs.log/20220526163440_airbyte-worker-76dd6c68f4-h6p7l_757b6c76e78c4d8a9b5992b26c78fc54): 2022-05-26 16:34:40 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos 2022-05-26 16:34:40 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos stdoutLocalPort = 9040 2022-05-26 16:34:40 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos stderrLocalPort = 9001 2022-05-26 16:34:40 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 16:34:40 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 16:34:40 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 16:34:40 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 16:34:40 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/dd674208-9f88-47c3-b097-9b037992462e/source_config.json apps/source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos:/config/source_config.json -c init 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/b9fe835b-8b21-4c19-ad95-e33269fc5564/FINISHED_UPLOADING apps/source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos:/config/FINISHED_UPLOADING -c init 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 16:34:41 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):306 - Waiting for init container to terminate before checking exit value... 2022-05-26 16:34:42 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):311 - Init container terminated with exit value 0. 2022-05-26 16:34:42 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-05-26 16:34:42 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 16:34:42 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 16:34:42 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 16:34:42 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 16:34:43 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 16:34:43 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.137.122 2022-05-26 16:34:43 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... Collecting content into /tmp/toBePublished13180901576951447974.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/74f13075-8581-4de3-bee9-141f50c08d75/0/logs.log/20220526163444_airbyte-worker-76dd6c68f4-h6p7l_c24eafa86e794f92bc1f482746227f67): Collecting content into /tmp/toBePublished9567510015357128282.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/02ca716b-2b21-4eab-9912-2aefc8c58215/0/logs.log/20220526163540_airbyte-worker-76dd6c68f4-h6p7l_757b6c76e78c4d8a9b5992b26c78fc54): 2022-05-26 17:04:45 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=78f8cf87-2095-4b82-a540-1b1160ece843, RunId=758d0b15-2c34-48bf-a924-acfb7a861c53, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='d509e3b2-19e3-30ff-affb-5f5c9c9ac8c4', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 17:04:45 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/b9d58b0f-035c-40f3-8495-5f8f976a6b88/0/logs.log in region null; compressed: false) 2022-05-26 17:04:45 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva Collecting content into /tmp/toBePublished13193808380801772132.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b9d58b0f-035c-40f3-8495-5f8f976a6b88/0/logs.log/20220526170445_airbyte-worker-76dd6c68f4-h6p7l_2954abe1afac4a5fb242ab14950b8ea6): 2022-05-26 17:04:45 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 17:04:45 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 17:04:45 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva 2022-05-26 17:04:45 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 17:04:45 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=d509e3b2-19e3-30ff-affb-5f5c9c9ac8c4, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 17:04:56 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 17:04:56 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva 2022-05-26 17:04:56 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-b9d58b0f-035c-40f3-8495-5f8f976a6b88-0-ujvva 2022-05-26 17:04:56 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 17:04:56 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 17:04:56 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. Collecting content into /tmp/toBePublished1769907387221456103.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b9d58b0f-035c-40f3-8495-5f8f976a6b88/0/logs.log/20220526170545_airbyte-worker-76dd6c68f4-h6p7l_2954abe1afac4a5fb242ab14950b8ea6): 2022-05-26 17:06:52 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=d427401b-00ba-4a8a-8479-ad3af3b4c810, RunId=a4c69bbf-b047-4cf1-92da-5684ff3d7239, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='8457b5c9-cf52-34ed-94bf-1ca2e9c66829', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 17:06:55 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/84e45599-ae75-41c1-a228-008e501aacbd/0/logs.log in region null; compressed: false) 2022-05-26 17:06:55 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb Collecting content into /tmp/toBePublished12121219000982040276.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/84e45599-ae75-41c1-a228-008e501aacbd/0/logs.log/20220526170655_airbyte-worker-76dd6c68f4-h6p7l_1989439c6c1f44b282fd342f1d562597): 2022-05-26 17:06:55 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 17:06:55 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb 2022-05-26 17:06:55 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 17:06:55 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 17:06:55 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=8457b5c9-cf52-34ed-94bf-1ca2e9c66829, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 17:07:05 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 17:07:05 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb 2022-05-26 17:07:05 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-84e45599-ae75-41c1-a228-008e501aacbd-0-bersb 2022-05-26 17:07:05 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 17:07:05 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 17:07:05 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. Collecting content into /tmp/toBePublished12890945729992197848.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/84e45599-ae75-41c1-a228-008e501aacbd/0/logs.log/20220526170755_airbyte-worker-76dd6c68f4-h6p7l_1989439c6c1f44b282fd342f1d562597): 2022-05-26 17:15:11 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=3c464533-1c64-4f33-a750-2f2762efcdb3, RunId=8e693037-4eb3-4a08-ae34-f63929bf06b9, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='0961295c-dde6-3475-908b-1e141696993e', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 17:15:18 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d/0/logs.log in region null; compressed: false) 2022-05-26 17:15:18 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma Collecting content into /tmp/toBePublished12116316855963295757.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d/0/logs.log/20220526171518_airbyte-worker-76dd6c68f4-h6p7l_615c048d251b420f8cb63df9ead98146): 2022-05-26 17:15:18 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 17:15:18 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma 2022-05-26 17:15:18 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 17:15:18 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 17:15:18 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=0961295c-dde6-3475-908b-1e141696993e, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 17:15:28 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 17:15:28 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma 2022-05-26 17:15:28 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d-0-euoma 2022-05-26 17:15:28 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 17:15:28 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 17:15:28 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. Collecting content into /tmp/toBePublished7213375404814926719.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/efeeb12f-3ee3-4d63-b1f4-40d32fe5be5d/0/logs.log/20220526171618_airbyte-worker-76dd6c68f4-h6p7l_615c048d251b420f8cb63df9ead98146): 2022-05-26 17:21:43 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=0ab00c04-0412-44a2-a528-c48a306d6f20, RunId=630b0890-4d06-447c-a406-6e7a0334ac6c, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='f652582c-94d0-359d-9314-80a138ee1b8c', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 17:21:47 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/c1d775d3-2a78-446c-9258-a3a11316bfa8/0/logs.log in region null; compressed: false) 2022-05-26 17:21:47 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj Collecting content into /tmp/toBePublished17089858486794187438.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/c1d775d3-2a78-446c-9258-a3a11316bfa8/0/logs.log/20220526172147_airbyte-worker-76dd6c68f4-h6p7l_f03d2a7fac2b4f9e88e4921aefd0e2b7): 2022-05-26 17:21:47 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 17:21:47 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj 2022-05-26 17:21:47 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 17:21:47 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 17:21:47 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=f652582c-94d0-359d-9314-80a138ee1b8c, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 17:21:57 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 17:21:57 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj 2022-05-26 17:21:57 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-c1d775d3-2a78-446c-9258-a3a11316bfa8-0-hrwxj 2022-05-26 17:21:57 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 17:21:57 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 17:21:57 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. Collecting content into /tmp/toBePublished6411909330336817706.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/c1d775d3-2a78-446c-9258-a3a11316bfa8/0/logs.log/20220526172247_airbyte-worker-76dd6c68f4-h6p7l_f03d2a7fac2b4f9e88e4921aefd0e2b7): 2022-05-26 17:34:40 ERROR i.t.i.s.WorkflowExecuteRunnable(logWorkflowExecutionException):125 - Workflow execution failure WorkflowId=1b63e71f-1a93-4fb1-b245-f0d1480d67b4, RunId=1e392b1a-d250-4845-aba6-edda7b14cdc9, WorkflowType=CheckConnectionWorkflow io.temporal.failure.ActivityFailure: scheduledEventId=5, startedEventId=6, activityType='Run', activityId='efd8a7dc-8ef0-356f-90a3-c7fd4d17ab5e', identity='', retryState=RETRY_STATE_NON_RETRYABLE_FAILURE at java.lang.Thread.getStackTrace(Thread.java:1610) ~[?:?] at io.temporal.internal.sync.ActivityStubBase.execute(ActivityStubBase.java:48) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandler.lambda$getActivityFunc$0(ActivityInvocationHandler.java:77) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.ActivityInvocationHandlerBase.invoke(ActivityInvocationHandlerBase.java:70) ~[temporal-sdk-1.6.0.jar:?] at jdk.proxy2.$Proxy43.run(Unknown Source) ~[?:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionWorkflowImpl.run(CheckConnectionWorkflowImpl.java:28) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation$RootWorkflowInboundCallsInterceptor.execute(POJOWorkflowImplementationFactory.java:317) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOWorkflowImplementationFactory$POJOWorkflowImplementation.execute(POJOWorkflowImplementationFactory.java:292) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowExecuteRunnable.run(WorkflowExecuteRunnable.java:72) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.SyncWorkflow.lambda$start$0(SyncWorkflow.java:137) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.CancellationScopeImpl.run(CancellationScopeImpl.java:101) [temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.WorkflowThreadImpl$RunnableWrapper.run(WorkflowThreadImpl.java:111) [temporal-sdk-1.6.0.jar:?] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:539) [?:?] at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.temporal.failure.TimeoutFailure: message='activity timeout', timeoutType=TIMEOUT_TYPE_SCHEDULE_TO_CLOSE 2022-05-26 17:34:40 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):207 - Running sync worker cancellation... Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/02ca716b-2b21-4eab-9912-2aefc8c58215/0/logs.log in region null; compressed: false) 2022-05-26 17:34:40 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos Collecting content into /tmp/toBePublished1353203789386283326.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/02ca716b-2b21-4eab-9912-2aefc8c58215/0/logs.log/20220526173440_airbyte-worker-76dd6c68f4-h6p7l_db3eb697040f48f7b2d65a11828c88ac): 2022-05-26 17:34:40 INFO i.a.w.t.TemporalAttemptExecution(lambda$getWorkerThread$2):174 - Completing future exceptionally... io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 3 more 2022-05-26 17:34:40 INFO i.a.w.t.TemporalAttemptExecution(get):141 - Stopping cancellation check scheduling... 2022-05-26 17:34:40 WARN i.t.i.s.POJOActivityTaskHandler(activityFailureToResult):363 - Activity failure. ActivityId=efd8a7dc-8ef0-356f-90a3-c7fd4d17ab5e, activityType=Run, attempt=1 java.util.concurrent.ExecutionException: io.airbyte.workers.WorkerException: Error while getting checking connection. at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?] at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.get(TemporalAttemptExecution.java:139) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.check.connection.CheckConnectionActivityImpl.run(CheckConnectionActivityImpl.java:81) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~[?:?] at jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:77) ~[?:?] at jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~[?:?] at java.lang.reflect.Method.invoke(Method.java:568) ~[?:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityInboundCallsInterceptor.execute(POJOActivityTaskHandler.java:286) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler$POJOActivityImplementation.execute(POJOActivityTaskHandler.java:252) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.sync.POJOActivityTaskHandler.handle(POJOActivityTaskHandler.java:209) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:193) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.ActivityWorker$TaskHandlerImpl.handle(ActivityWorker.java:151) ~[temporal-sdk-1.6.0.jar:?] at io.temporal.internal.worker.PollTaskExecutor.lambda$process$0(PollTaskExecutor.java:73) ~[temporal-sdk-1.6.0.jar:?] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) [?:?] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) [?:?] at java.lang.Thread.run(Thread.java:833) [?:?] Caused by: io.airbyte.workers.WorkerException: Error while getting checking connection. at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:84) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.io.UncheckedIOException: java.net.SocketException: Socket closed at java.io.BufferedReader$1.hasNext(BufferedReader.java:574) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more Caused by: java.net.SocketException: Socket closed at sun.nio.ch.NioSocketImpl.endRead(NioSocketImpl.java:248) ~[?:?] at sun.nio.ch.NioSocketImpl.implRead(NioSocketImpl.java:327) ~[?:?] at sun.nio.ch.NioSocketImpl.read(NioSocketImpl.java:350) ~[?:?] at sun.nio.ch.NioSocketImpl$1.read(NioSocketImpl.java:803) ~[?:?] at java.net.Socket$SocketInputStream.read(Socket.java:966) ~[?:?] at sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:270) ~[?:?] at sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:313) ~[?:?] at sun.nio.cs.StreamDecoder.read(StreamDecoder.java:188) ~[?:?] at java.io.InputStreamReader.read(InputStreamReader.java:177) ~[?:?] at java.io.BufferedReader.fill(BufferedReader.java:162) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:329) ~[?:?] at java.io.BufferedReader.readLine(BufferedReader.java:396) ~[?:?] at java.io.BufferedReader$1.hasNext(BufferedReader.java:571) ~[?:?] at java.util.Spliterators$IteratorSpliterator.tryAdvance(Spliterators.java:1855) ~[?:?] at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:129) ~[?:?] at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:527) ~[?:?] at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:513) ~[?:?] at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:499) ~[?:?] at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:150) ~[?:?] at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:?] at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:647) ~[?:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:64) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.DefaultCheckConnectionWorker.run(DefaultCheckConnectionWorker.java:27) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:171) ~[io.airbyte-airbyte-workers-0.35.12-alpha.jar:?] ... 1 more 2022-05-26 17:34:40 WARN i.a.c.i.LineGobbler(voidCall):86 - generic gobbler IOException: Socket closed. Typically happens when cancelling a job. 2022-05-26 17:34:40 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos 2022-05-26 17:34:50 WARN i.a.w.WorkerUtils(closeProcess):56 - Process is still alive after calling destroy. Attempting to destroy forcibly... 2022-05-26 17:34:50 INFO i.a.w.p.KubePodProcess(destroy):582 - Destroying Kube process: source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos 2022-05-26 17:34:50 INFO i.a.w.p.KubePodProcess(destroy):588 - Destroyed Kube process: source-gitlab-sync-02ca716b-2b21-4eab-9912-2aefc8c58215-0-qhcos 2022-05-26 17:34:50 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):211 - Interrupting worker thread... 2022-05-26 17:34:50 INFO i.a.w.t.TemporalAttemptExecution(lambda$getCancellationChecker$3):214 - Cancelling completable future... 2022-05-26 17:34:50 WARN i.a.w.t.CancellationHandler$TemporalCancellationHandler(checkAndHandleCancellation):54 - Job either timed out or was cancelled. Collecting content into /tmp/toBePublished674540228000636770.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/02ca716b-2b21-4eab-9912-2aefc8c58215/0/logs.log/20220526173540_airbyte-worker-76dd6c68f4-h6p7l_db3eb697040f48f7b2d65a11828c88ac): 2022-05-26 18:04:00 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/b29363dc-ab9a-42b1-b327-54bb5a1ba5c6/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/b29363dc-ab9a-42b1-b327-54bb5a1ba5c6/0/logs.log in region null; compressed: false) 2022-05-26 18:04:00 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished4579329694022316527.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b29363dc-ab9a-42b1-b327-54bb5a1ba5c6/0/logs.log/20220526180400_airbyte-worker-76dd6c68f4-h6p7l_47b767268ad34451ae9e6f7a7b5919ba): 2022-05-26 18:04:00 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-b29363dc-ab9a-42b1-b327-54bb5a1ba5c6-0-pymqr 2022-05-26 18:04:00 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-b29363dc-ab9a-42b1-b327-54bb5a1ba5c6-0-pymqr stdoutLocalPort = 9002 2022-05-26 18:04:00 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-b29363dc-ab9a-42b1-b327-54bb5a1ba5c6-0-pymqr stderrLocalPort = 9003 2022-05-26 18:04:00 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 18:04:00 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 18:04:00 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 18:04:00 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 18:04:01 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/62acc29a-e7a2-4058-aaf1-837c4df22c4e/source_config.json apps/source-gitlab-sync-b29363dc-ab9a-42b1-b327-54bb5a1ba5c6-0-pymqr:/config/source_config.json -c init 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/e9e52f7b-b56d-4db9-b064-7b8ed09ef34c/FINISHED_UPLOADING apps/source-gitlab-sync-b29363dc-ab9a-42b1-b327-54bb5a1ba5c6-0-pymqr:/config/FINISHED_UPLOADING -c init 2022-05-26 18:04:04 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:04:05 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:04:05 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 18:04:13 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 18:04:13 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 18:04:17 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 18:04:17 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.106.17 2022-05-26 18:04:17 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... 2022-05-26 18:04:33 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/89395c08-5396-4b68-8d33-ece1fe205ffe/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/89395c08-5396-4b68-8d33-ece1fe205ffe/0/logs.log in region null; compressed: false) 2022-05-26 18:04:33 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished9973655340645192537.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/89395c08-5396-4b68-8d33-ece1fe205ffe/0/logs.log/20220526180433_airbyte-worker-76dd6c68f4-h6p7l_5957f7303f9244958d12e518a867c11d): 2022-05-26 18:04:33 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-89395c08-5396-4b68-8d33-ece1fe205ffe-0-nvmsn 2022-05-26 18:04:33 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-89395c08-5396-4b68-8d33-ece1fe205ffe-0-nvmsn stdoutLocalPort = 9004 2022-05-26 18:04:33 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-89395c08-5396-4b68-8d33-ece1fe205ffe-0-nvmsn stderrLocalPort = 9005 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/f0dbaef9-4162-4e83-832e-6743b4a1a530/source_config.json apps/source-gitlab-sync-89395c08-5396-4b68-8d33-ece1fe205ffe-0-nvmsn:/config/source_config.json -c init 2022-05-26 18:04:33 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:04:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:04:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 18:04:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/e059e1e3-fdde-4a69-9d16-27dd4265f0bf/FINISHED_UPLOADING apps/source-gitlab-sync-89395c08-5396-4b68-8d33-ece1fe205ffe-0-nvmsn:/config/FINISHED_UPLOADING -c init 2022-05-26 18:04:34 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:04:34 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):306 - Waiting for init container to terminate before checking exit value... 2022-05-26 18:04:35 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):311 - Init container terminated with exit value 0. 2022-05-26 18:04:35 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-05-26 18:04:35 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:04:35 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 18:04:35 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 18:04:36 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 18:04:36 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 18:04:36 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.114.111 2022-05-26 18:04:36 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... 2022-05-26 18:04:40 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/fae8da68-5d0a-4e83-8c8a-799eee7681a1/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/fae8da68-5d0a-4e83-8c8a-799eee7681a1/0/logs.log in region null; compressed: false) 2022-05-26 18:04:40 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished5402749401834538437.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/fae8da68-5d0a-4e83-8c8a-799eee7681a1/0/logs.log/20220526180440_airbyte-worker-76dd6c68f4-h6p7l_45b118eebbed4f658e3cecb165b851f6): 2022-05-26 18:04:40 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-fae8da68-5d0a-4e83-8c8a-799eee7681a1-0-nhswd 2022-05-26 18:04:40 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-fae8da68-5d0a-4e83-8c8a-799eee7681a1-0-nhswd stdoutLocalPort = 9006 2022-05-26 18:04:40 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-fae8da68-5d0a-4e83-8c8a-799eee7681a1-0-nhswd stderrLocalPort = 9007 2022-05-26 18:04:40 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 18:04:40 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 18:04:40 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 18:04:40 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 18:04:40 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/3657c2e8-90bf-4957-b1d9-72df65dabd0c/source_config.json apps/source-gitlab-sync-fae8da68-5d0a-4e83-8c8a-799eee7681a1-0-nhswd:/config/source_config.json -c init 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/698d547e-17e1-4aff-8b16-8102df73bd35/FINISHED_UPLOADING apps/source-gitlab-sync-fae8da68-5d0a-4e83-8c8a-799eee7681a1-0-nhswd:/config/FINISHED_UPLOADING -c init 2022-05-26 18:04:41 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:04:42 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:04:42 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 18:04:42 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 18:04:42 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 18:04:43 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 18:04:43 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.114.1 2022-05-26 18:04:43 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... Collecting content into /tmp/toBePublished12325899629676210770.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/b29363dc-ab9a-42b1-b327-54bb5a1ba5c6/0/logs.log/20220526180500_airbyte-worker-76dd6c68f4-h6p7l_47b767268ad34451ae9e6f7a7b5919ba): Collecting content into /tmp/toBePublished235696353800992384.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/89395c08-5396-4b68-8d33-ece1fe205ffe/0/logs.log/20220526180533_airbyte-worker-76dd6c68f4-h6p7l_5957f7303f9244958d12e518a867c11d): Collecting content into /tmp/toBePublished9113321653716143056.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/fae8da68-5d0a-4e83-8c8a-799eee7681a1/0/logs.log/20220526180540_airbyte-worker-76dd6c68f4-h6p7l_45b118eebbed4f658e3cecb165b851f6): 2022-05-26 18:07:20 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/5d58be9f-e843-437a-985d-56e7792b6113/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/5d58be9f-e843-437a-985d-56e7792b6113/0/logs.log in region null; compressed: false) 2022-05-26 18:07:20 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished16802674499152055494.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/5d58be9f-e843-437a-985d-56e7792b6113/0/logs.log/20220526180720_airbyte-worker-76dd6c68f4-h6p7l_0cd9fc93a2f24342821290b7db4dfcb3): 2022-05-26 18:07:20 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-5d58be9f-e843-437a-985d-56e7792b6113-0-umtyj 2022-05-26 18:07:20 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-5d58be9f-e843-437a-985d-56e7792b6113-0-umtyj stdoutLocalPort = 9008 2022-05-26 18:07:20 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-5d58be9f-e843-437a-985d-56e7792b6113-0-umtyj stderrLocalPort = 9009 2022-05-26 18:07:20 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 18:07:20 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 18:07:20 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 18:07:20 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 18:07:21 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/a8e79412-224e-4cff-8173-d5d98c0def5d/source_config.json apps/source-gitlab-sync-5d58be9f-e843-437a-985d-56e7792b6113-0-umtyj:/config/source_config.json -c init 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/a2a80543-8eac-4bfc-8907-fd607b1bd7dd/FINISHED_UPLOADING apps/source-gitlab-sync-5d58be9f-e843-437a-985d-56e7792b6113-0-umtyj:/config/FINISHED_UPLOADING -c init 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:07:22 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 18:07:23 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 18:07:23 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 18:07:24 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 18:07:24 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.105.150 2022-05-26 18:07:24 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... Collecting content into /tmp/toBePublished11472833058496791828.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/5d58be9f-e843-437a-985d-56e7792b6113/0/logs.log/20220526180820_airbyte-worker-76dd6c68f4-h6p7l_0cd9fc93a2f24342821290b7db4dfcb3): 2022-05-26 18:09:45 INFO i.a.w.t.TemporalAttemptExecution(get):117 - Cloud storage job log path: /workspace/72291a43-3366-49de-a776-e39ca6b6481f/0/logs.log Using cache monitor: TimePeriodBasedBufferMonitor(periodInSeconds: 60) Registering AWS S3 publish helper -> S3 configuration (airbyte-dev-logs:job-logging/workspace/72291a43-3366-49de-a776-e39ca6b6481f/0/logs.log in region null; compressed: false) 2022-05-26 18:09:45 INFO i.a.w.t.TemporalAttemptExecution(get):120 - Executing worker wrapper. Airbyte version: 0.35.12-alpha Collecting content into /tmp/toBePublished3882872196984237998.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/72291a43-3366-49de-a776-e39ca6b6481f/0/logs.log/20220526180945_airbyte-worker-76dd6c68f4-h6p7l_1dd9f3e855054038826b63526db2a028): 2022-05-26 18:09:45 INFO i.a.w.p.KubeProcessFactory(create):112 - Attempting to start pod = source-gitlab-sync-72291a43-3366-49de-a776-e39ca6b6481f-0-cekpc 2022-05-26 18:09:45 INFO i.a.w.p.KubeProcessFactory(create):115 - source-gitlab-sync-72291a43-3366-49de-a776-e39ca6b6481f-0-cekpc stdoutLocalPort = 9010 2022-05-26 18:09:45 INFO i.a.w.p.KubeProcessFactory(create):118 - source-gitlab-sync-72291a43-3366-49de-a776-e39ca6b6481f-0-cekpc stderrLocalPort = 9011 2022-05-26 18:09:45 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):520 - Creating stdout socket server... 2022-05-26 18:09:45 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):531 - Creating stderr socket server... 2022-05-26 18:09:45 INFO i.a.w.p.KubePodProcess():479 - Creating pod... 2022-05-26 18:09:45 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):289 - Waiting for init container to be ready before copying files... 2022-05-26 18:09:45 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):292 - Init container present.. 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToRun):295 - Init container ready.. 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess():484 - Copying files... 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: source_config.json 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/f79c9047-e043-48d3-9d0a-cf2c7f7919e3/source_config.json apps/source-gitlab-sync-72291a43-3366-49de-a776-e39ca6b6481f-0-cekpc:/config/source_config.json -c init 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):239 - Uploading file: FINISHED_UPLOADING 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):247 - kubectl cp /tmp/9807f9e7-a154-4a72-b0e6-a2756ea73353/FINISHED_UPLOADING apps/source-gitlab-sync-72291a43-3366-49de-a776-e39ca6b6481f-0-cekpc:/config/FINISHED_UPLOADING -c init 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):250 - Waiting for kubectl cp to complete 2022-05-26 18:09:47 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):306 - Waiting for init container to terminate before checking exit value... 2022-05-26 18:09:48 INFO i.a.w.p.KubePodProcess(waitForInitPodToTerminate):311 - Init container terminated with exit value 0. 2022-05-26 18:09:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):258 - Init was successful; ignoring non-zero kubectl cp exit code for success indicator file. 2022-05-26 18:09:48 INFO i.a.w.p.KubePodProcess(copyFilesToKubeConfigVolume):264 - kubectl cp complete, closing process 2022-05-26 18:09:48 INFO i.a.w.p.KubePodProcess():487 - Waiting until pod is ready... 2022-05-26 18:09:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$8):522 - Setting stdout... 2022-05-26 18:09:48 INFO i.a.w.p.KubePodProcess(lambda$setupStdOutAndStdErrListeners$9):533 - Setting stderr... 2022-05-26 18:09:49 INFO i.a.w.p.KubePodProcess():501 - Reading pod IP... 2022-05-26 18:09:49 INFO i.a.w.p.KubePodProcess():503 - Pod IP: 10.172.116.99 2022-05-26 18:09:49 INFO i.a.w.p.KubePodProcess():510 - Using null stdin output stream... Collecting content into /tmp/toBePublished9736193578100205699.tmp before uploading. Publishing to S3 (bucket=airbyte-dev-logs; key=job-logging/workspace/72291a43-3366-49de-a776-e39ca6b6481f/0/logs.log/20220526181045_airbyte-worker-76dd6c68f4-h6p7l_1dd9f3e855054038826b63526db2a028):