Dynamic file source URL in Airbyte low-code for SFTP server

Summary

The user is inquiring about adding a dynamic part to the URL in Airbyte low-code for the File source connector to ingest xlsx files from a SFTP server with date-related suffixes. They want to know if it’s possible to make the URL dynamic to search for a new file every day.


Question

Hello guys!
I am using Airbyte low-code and trying to use a File source for ingesting directly xlsx files from a SFTP server, but the files are coming with a sufix related to the date, like example_extraction20240801.xlsx.
I would want to know if in the part of the URL I can add a dynamic part for the string of the URL created to be dynamic, like everyday searching for a new file, just like: <sftp://path/to/the/files/example_extraction{{> day_delta(-1, format='%Y%m%d') }}.xlsx
Thanks for the support :wink:



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["dynamic-file-source-url", "airbyte-low-code", "file-source-connector", "sftp-server", "dynamic-url", "date-suffix"]