Datatype mismatch issue with BigQuery connectors

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Airbyte is transforming datatype OBJECT to JSON instead of RECORD in BigQuery connectors, causing datatype mismatch issues.


Question

Hi!

I am working on extracting data out of bigquery (X instance) and put the data into bigquery( Y instance) . Problem I am facing is the datatype mismatch, airbyte tends to transform datatype OBJECT to JSON while it should be RECORD. This is causing a lot of problem in handling datatypes. Any fix for this?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["datatype-mismatch", "bigquery-connector", "airbyte"]
2

hey <@U05GZES00KV> I am facing a similar issue where my source is something else, but I think the new bigquery destination connector creates JSON type columns for all source. All I could find is to used JSON_VALUE to extract columns from this JSON.
Anyone else with a better solution?

3

I wrote a UDF function to dynamically handle this