Is this your first time deploying Airbyte?: Yes
OS Version / Instance: Running in K8S within a local MacBook (M1 Chip).
Deployment: K8S (local)
Airbyte Version: 0.39.1-alpha
Source name/version: airbyte/source-postgres 0.4.16
Destination name/version: airbyte/destination-s3 0.3.6
Step: When you add the destination, does not seem to be any partition possibility?
Description:
Is there anyone that know how to configure partitioning of columns of files when using parquet for S3 destination? It seems like Airbyte only can dump files given a hardcoded prefix, rather than having a partitioning strategy based on a column value of the data?
I am loading the data as parquet
.