Intercom sync successful but fails and retries

Troubleshooting
#1
  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Linux EC2
  • Memory / Disk: 8Gb
  • Deployment: Docker
  • Airbyte Version: 0.38.4
  • Source name/version: Intercom 0.1.18 (latest)
  • Destination name/version: Snowflake 0.4.26 (latest)
  • Step: Issue occurs during sync.
  • Description: Intercom sync seems to be successful but retries and fails. Attached image and logs below.

intercom-success-but-fail
intercom-success-but-fail1920×945 194 KB

logs-1819.txt (161.3 KB)

#2

Hey can you help me with all the stream names you are trying to sync?

#3

intercom-streams
intercom-streams1260×522 76.5 KB

These are the streams. For all the streams that had Incremental Deduped available, I have selected those, for the rest I have selected Full Refresh Overwrite

#4

Can you try removing conversation_parts and try again?

#5

I have removed conversation_parts then reset and resynced.

The sync took 7 hours on a t3 large instance. It seems the conversation stream syncs 1000 records every 20 minutes or so. I have stopped the sync for now as it was using up quite some CPU credits. (CPU usage was 50% for 7 hours)

#6

Looks like there is some error over conversation_parts feel free to open an issue in github around this