Syncing Data from MySQL to BigQuery

Summary

Guide on fixing sync delay and reducing sync frequency from 1 hour to 30 minutes


Question

Hello Community,
I am syncing data from MySQL to BigQuery with a sync frequency of 1 hour. However, sometimes the process takes longer than expected. Could anyone guide me on how to fix this issue?
Additionally, I would like to reduce the sync frequency from 1 hour to 30 minutes. Any suggestions would be greatly appreciated.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["syncing-data", "mysql-connector", "bigquery-connector", "sync-frequency", "sync-delay"]

regarding frequency, use cron expression
e.g 0 0/30 * ? * * *