Date type written as dictionnary for parquet format in s3 destination

Troubleshooting
#1
  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Kubernetes
  • Memory / Disk: unlimited (scalable cluster)
  • Deployment: Kubernetes
  • Airbyte Version: 0.35.64-alpha
  • Source name/version: source-google-analytics-v4 0.3.22
  • Destination name/version: destination-s3 / 0.3.5
  • Step: The issue is happening during sync
  • Description: the date column of the Google analytics are written as a dictionnary in parquet file instead of string
    image
    image1067×345 17.4 KB

I did try to sync to the s3 destination in json format, and it worked (the dates were strings)
is this a bug or this is how parquet encode dates ?

#2

I created the issue https://github.com/airbytehq/airbyte/issues/14028 looks it’s a bug with S3 destination connector. I added to connector roadmap to solve it. I’ll update you when this is fix.