Sorting data during ingestion for Google Search Console in Airbyte

Summary

Inquiring about sorting data during ingestion for Google Search Console in Airbyte to handle limitations on data download per day per query type.


Question

Hi everyone, we are ingesting google search console data with Airbyte. However there seems to be a limitation of google search console that it only allows us to download 50k per day per query type, which we exceed. Is it possible to sort the data based on one column (e.g impressions in descending order) during the ingestion, so the rows beyond 50k are the long-tailed data.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["google-search-console", "data-ingestion", "sorting-data", "limitation", "airbyte"]