Sync Failure Due to Large Record Size

Summary

User is experiencing a sync failure between Snapchat and GCP Pub/Sub in Airbyte due to a record being too large to process. Seeking solutions to resolve the issue promptly.


Question

Hello there I have a connection between Snapchat and GCP Pub/Sub on cloud Airbyte and I was trying to sync the data till the job failed.
One record is too big and can't be processed, the sync will be failed
Does anyone know how this can be solved, I am collecting data for a real client in real time and this happened. So I need to solve this ASAP if can anyone help with it, will be much appreciated.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['snapchat', 'gcp-pubsub', 'sync-failure', 'large-record']