Trouble flattening data from airbyte_internal dataset to destination dataset in BigQuery using pyairbyte

Summary

Data from airbyte_internal dataset not appearing in destination dataset in BigQuery, _airbyte_extracted_at showing date from 1970. Using pyairbyte for data extraction and loading.


Question

Hello everyone,
I’m having trouble flattening data from the airbyte_internal dataset to my destination dataset in BigQuery. Data is appearing in airbyte_internal, but the destination columns are empty except for the Airbyte-generated fields. Also, the _airbyte_extracted_at shows a date from 1970. I’m using pyairbyte to extract and load data.
Any ideas on what could be causing this?
Thanks!



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["flattening-data", "airbyte-internal-dataset", "destination-dataset", "bigquery", "pyairbyte", "data-extraction", "data-loading"]