Sync job failuring and retries itself after successfuly done

Troubleshooting
,
#1
  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: Ubuntu
  • Memory / Disk:
  • Deployment: Kubernetes
  • Airbyte Version: 0.36.0-alpha
  • Source name/version: Google Analytics (0.1.18)
  • Destination name/version: Redshift (0.3.28)
  • Step: The issue is happening during sync
  • Description:

The connector from Google Analytics to Redshift is reporting the erros: “ERROR i.a.w.DefaultReplicationWorker(run):169 - Sync worker failed.” and ERROR i.a.i.d.b.BufferedStreamConsumer(close):191 - Close failed. despite these erros the logs reports that the Sync was completed successfully. Below the logs.
logs-112.txt (30.0 KB)

#2

how much resources memory/disk the cluster have?

#4

@marcosmarxm

webapp:
Memory: 1Gi / CPU: 1

scheduler:
Memory: 1Gi / CPU: 1

podSweeper:
Memory: 512Mi / CPU: 500m

Server:
Memory: 6Gi / CPU: 2

Worker:
Memory: 1Gi / CPU: 1

#5

Can you increase the worker memory?

#6

Also could you try a toy connector like PokeAPI to your destination just to validate the pipeline is working?