Optimizing data transfer speed from Google Ads API to GCP BigQuery

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Optimizing data transfer speed from Google Ads API to GCP BigQuery using default configurations in Airbyte


Question

Hello everyone, I am fetching data from google ads api to gcp bigquery. It is taking quite long time. Is there any way to make it fast ? I am using default configurations

Right now i am airbyte is taking 35h for pulling 50 gbs of data ? Is it good okay or bad ?


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["google-ads-api", "gcp-bigquery", "data-transfer-speed", "default-configurations", "airbyte"]
2

Right now i am airbyte is taking 35h for pulling 50 gbs of data ? Is it good okay or bad ?

3

Quick search in Google pointed out different option
https://www.ga4bigquery.com/how-to-set-up-the-google-ads-data-transfer-to-bigquery/
https://cloud.google.com/bigquery/docs/google-ads-transfer

You are using 2 Google products/services, so I’d recommend checking that approach

4

One reason i skipped using this, this data transfer service doesn’t have options of taking refresh tokens and we didn’t want to do oauth as it will impact our clients ( extra work).