Today Airbyte only works with batch syncs. The minimum cadence using the default scheduler is 5 minutes. You can trigger in less time using the API configuring the connection to sync with manual trigger. One observation is: Airbyte launches Docker Containers to sync data between source and destination and using a small time between syncs can cause some system degradation.
Related topics
Topic | Replies | Views | Activity | |
---|---|---|---|---|
Optimizing data sync performance in Airbyte for API based transformers like Stripe | 2 | 17 | October 11, 2024 | |
Setting more frequent sync in Airbyte OSS version | 2 | 10 | August 1, 2024 | |
Optimizing Sync Time for CDC with Airbyte | 0 | 21 | December 9, 2024 | |
Help Needed to Configure Airbyte for MySQL and BigQuery Real-Time Data Synchronisation | 0 | 29 | October 16, 2024 | |
Availability of Airbyte API for updating frequency | 4 | 10 | October 25, 2024 |