Flattening Data in Iceberg Connector for Airbyte Destination

Summary

The user is looking for guidance on flattening data in the Iceberg connector for Airbyte destination to have normalized data similar to the Airbyte S3 connector.


Question

Hi All , I am working on airbyte destination iceberg connector integration in my pipeline. iceberg connector write the entire data as json text in ‘_airbyte_data’ column . but we want to have it flatten data (normalized) like we have it airbyte s3 connector. any idea and any suggestion/guidance greatly help us avoiding redundant pipeline to take care this data flatten(normalisation) process .



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["iceberg-connector", "airbyte-destination", "data-flattening", "normalization", "pipeline"]