Sync usually works, but randomly hangs forever

Connector Questions & Issues
, ,
1
  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: Windows
  • Deployment: Docker
  • Airbyte Version: 0.39.23
  • Source name/version: Google Ads 0.1.44
  • Destination name/version: MS SQL Server 0.1.20
  • Step: Sync
  • Description: Sync usually works on a daily basis taking about 30min to run, but occasionally the sync hangs forever and is manually cancelled after 8 - 10 hours. The next day the sync runs fine. The issue then pops up again randomly a week or so later.

Example of the log hanging for hours and manually cancelled:
logs-858.txt (28.5 KB)

The below multiple binding error occurs even when the job succeeds so I don’t believe this is the issue. 2022-08-12 14:02:05 ERROR i.a.c.i.LineGobbler(voidCall):82 - SLF4J: Class path contains multiple SLF4J bindings.

Example of successful log:
logs-840.txt (48.0 KB)

2

Hi @robsnyder7, could you please update your version of Airbyte and the MS SQL Server destination connector? Those are far behind the current versions and that might be causing issues.

3

Thanks for the feedback, I’ll try updating the Airbyte version.

It looks like the MS SQL Server version 0.1.20 is the latest version already.

image
image1569×99 9.38 KB

4

I was facing similar issue and it got resolved after upgrading airbyte and temporal version .

My setting
appVersion: “0.39.42-alpha”
temporal : appVersion: “1.17.2”

5

Thanks for the insight, @sivankumar86! @robsnyder7 could you check if this fixes your issue?

6

Updating the airbyte version fixed the sync issues, thank you for the help!