Configuring Airbyte to import new Parquet files from GCS automatically

Summary

You want to configure Airbyte to automatically import new Parquet files from a GCS bucket without modifying the schema.


Question

One of the services we use exports data to GCS in Parquet file format, and we have hundreds of these files in a GCS bucket

Is there a way to configure Airbyte to import these new ones as they appear? I don’t want to modify the schema or anything



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["configure", "airbyte", "import", "parquet-files", "gcs", "automatic", "schema"]