Handling large records causing sync failure between Snapchat and GCP Pub/Sub on Airbyte

Summary

When syncing data between Snapchat and GCP Pub/Sub on Airbyte, a large record is causing the sync to fail. The error message indicates that one record is too big to be processed. Assistance is needed to resolve this issue promptly.


Question

Hello there I have a connection between Snapchat and GCP Pub/Sub on cloud Airbyte and I was trying to sync the data till the job failed.
One record is too big and can't be processed, the sync will be failed
Does anyone know how this can be solved, I am collecting data for a real client in real time and this happened. So I need to solve this ASAP if can anyone help with it, will be much appreciated.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["snapchat-connector", "gcp-pubsub-connector", "data-sync", "large-record", "sync-failure"]