Hello there,
I followed the topic for BigQuery SQL optimization which is something we are looking for from our side as well (BigQuery SQL optimization).
Our case is quite similar but our query is in even more raw state as the one provided in the mentioned topic.
The current query is reading through the whole table which is not optimal at all. The solution provided in here (normalization: bigquery partition pruning optimization by brunofaustino · Pull Request #14485 · airbytehq/airbyte · GitHub) sounds great but how do we implement it on our airbyte instance ?
Your help would be greatly appreciated!