Flattening JSON columns to nested columns in BigQuery

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

How to dynamically flatten JSON columns to nested columns in BigQuery either before or after loading into the raw table.


Question

Hi, I have question regarding destination-Bigquery :
I get a JSON columns in a stream which I want to flatten to nested columns in bigquery.
How do I achieve this either after loading in the raw table or before loading it?
P.S. I want it to be dynamic, i.e. create all the available columns in the JSON


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["destination-bigquery", "json-columns", "flatten", "nested-columns", "dynamic"]
2

Doesnt default normalization do this?