Combining Monthly Transactional Files into One Single File in Snowflake


How to dynamically combine monthly transactional files into one single file in Snowflake, including handling future files that have not been generated yet


Hi :wave: Has anyone tried combining/unioning monthly transactional files dynamically into one single file in the destination warehouse (Snowflake in our case)?

For example,

All of above should be unioned into one single file called `files_2024`. However, the files for *Mar 2024 onwards* have not been generated yet. When they are generated on the first day of month, they will start syncing. I d want the records to load into the `files_2024`  table in snowflake



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here]( if you want to access the original thread.

[Join the conversation on Slack](

["combine-monthly-files", "snowflake-warehouse", "dynamic-union", "transactional-files"]