S3 Data Partitioning - Destination

Is this your first time deploying Airbyte?: Yes

OS Version / Instance: Running in K8S within a local MacBook (M1 Chip).

Deployment: K8S (local)

Airbyte Version: 0.39.1-alpha

Source name/version: airbyte/source-postgres 0.4.16

Destination name/version: airbyte/destination-s3 0.3.6

Step: When you add the destination, does not seem to be any partition possibility?


Is there anyone that know how to configure partitioning of columns of files when using parquet for S3 destination? It seems like Airbyte only can dump files given a hardcoded prefix, rather than having a partitioning strategy based on a column value of the data?

I am loading the data as parquet.

Hey I don’t think we have that feature. I would suggest to create an issue in github as an improvement so that team or anyone can contribute for it