Intercom sync successful but fails and retries

  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Linux EC2
  • Memory / Disk: 8Gb
  • Deployment: Docker
  • Airbyte Version: 0.38.4
  • Source name/version: Intercom 0.1.18 (latest)
  • Destination name/version: Snowflake 0.4.26 (latest)
  • Step: Issue occurs during sync.
  • Description: Intercom sync seems to be successful but retries and fails. Attached image and logs below.

logs-1819.txt (161.3 KB)

Hey can you help me with all the stream names you are trying to sync?

These are the streams. For all the streams that had Incremental Deduped available, I have selected those, for the rest I have selected Full Refresh Overwrite

Can you try removing conversation_parts and try again?

I have removed conversation_parts then reset and resynced.

The sync took 7 hours on a t3 large instance. It seems the conversation stream syncs 1000 records every 20 minutes or so. I have stopped the sync for now as it was using up quite some CPU credits. (CPU usage was 50% for 7 hours)

Looks like there is some error over conversation_parts feel free to open an issue in github around this