S3 Data Partitioning - Destination

Is this your first time deploying Airbyte?: Yes

OS Version / Instance: Running in K8S within a local MacBook (M1 Chip).

Deployment: K8S (local)

Airbyte Version: 0.39.1-alpha

Source name/version: airbyte/source-postgres 0.4.16

Destination name/version: airbyte/destination-s3 0.3.6

Step: When you add the destination, does not seem to be any partition possibility?

Description:

Is there anyone that know how to configure partitioning of columns of files when using parquet for S3 destination? It seems like Airbyte only can dump files given a hardcoded prefix, rather than having a partitioning strategy based on a column value of the data?

I am loading the data as parquet.

Hey I don’t think we have that feature. I would suggest to create an issue in github as an improvement so that team or anyone can contribute for it