Handling Scale of Multiple API Endpoints for Data Ingestion in Airbyte

Slack Knowledge Base Q&A Connector Development
, , , ,
1

Summary

Airbyte’s capability to handle a large number of partners with varying API endpoints for data ingestion across multiple products.


Question

thanks for quick response <@U05JENRCF7C>… we have 100s of partners each having different api endpoints (min 5 - max 20) for data ingestion requirement currently across 6 products. So we will have minimum of 100x5 (min endpoints)x6 = 3000 connections at a minimum scale. Can airbyte handle this scale? I mean its going to keep increasing.


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["api-endpoints", "data-ingestion", "scale", "partners", "airbyte-platform"]