Error loading data from gsheets to BigQuery in different regions

Summary

When trying to load data from gsheets to BigQuery in regions other than US, receiving a 400 Bad Request error with code 3848323 and status INVALID_ARGUMENT. Need help identifying the issue.


Question

Hi All,
I just started exploring Airbyte.
I tried extract and loading data from gsheets to bigquery. I was success for US dataset location. The table was created.
For us-central1 region or EU region getting below error
400 Bad Request POST https://bigquery.googleapis.com/upload/bigquery/v2/projects/accel-uk-meltano-demo-2024/jobs?uploadType=resumable { “error”: { “code”: 400, “message”: “Error: 3848323”, “errors”: [ { “message”: “Error: 3848323”, “domain”: “global”, “reason”: “invalid” } ], “status”: “INVALID_ARGUMENT” } }
What will be the issue?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["gsheets", "bigquery", "400-bad-request", "region", "invalid-argument"]

HI <@U04DKTD55DY> , I can’t see DV 360 source in my installed Airbyte connectors. Is there any reason?

Hi <@U04DKTD55DY>, different destination setup means?
I didn’t get you.
actually i want to create the table in the eu region or other region instead of us-central1. I am facing above error.
I checked for organisational restrictions, those also not present in the project

Hey <@U06QGFAR509> when Setting up a Bigquery Destination in Airbyte you choose the “dataset location” (see screenshot)- When you are creating a sync the dataset you’re targeting must match this location. You can however setup multiple copies of your Bigquery Destiantion, configuring a different dataset location

Got it, I chosen locations are same(dataset location in the airbyte and dataset location bigquery) both are same.

just to confirm - you have multiple bigquery destinations set up for each of your syncs? so one destination is us, one is eu, etc?

yes, I just created for testing.
Also I have multiple/different source created.

Hi <@U01MMSDJGC9> , I check it. But, those are not related my issue

Hey <@U06QGFAR509> do you have different destinations setup setup for each region?