Error while ingesting data from MSSQL to BigQuery

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Error encountered when ingesting data from MSSQL to BigQuery using the MSSQL source connector. Data is stored as JSON in BigQuery, how to change it to rows and columns.


Question

Hello everyone I got the error below while trying to Ingest data from MSSQL to BigQuery

java.util.concurrent.CompletionException: io.airbyte.integrations.base.destination.typing_deduping.UnexpectedSchemaException: Destination V2 Raw Table does not match expected Schema at java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)

Using MSSQL source connector

What I’ve tried.
Setting Destination namespace to Source defined.
After doing that it worked, however data is stored as Json on Bigquery, how can I change it to rows and column.

Helps and solutions will be appreciated :heart_hands:


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["error", "ingest-data", "mssql-connector", "bigquery", "json", "rows-and-columns"]
2

This is the temporary raw table that gets created. By the looks of the error you’re getting, it looks like the it’s failing to create the final destination tables.

Can you double-check that you don’t have the “Disable Final Tables.” option enabled (under Advanced) on your Destination connector settings?