Summary
The user is looking for a way to backfill daily data from an API that only returns cumulative data using the Connector Builder. They have tried setting start and end dates but are unable to backfill data beyond the date they start running the connector. They are specifically asking if there is a way to loop the request from a start date on a daily granularity.
Question
Using the connector builder is there a way to backfill daily data from an API that only returns cumulative data?
The API returns cumulative data from a start date and end date. I created a connector that streams daily data by setting the start date and end date with
"endDate": "{{ day_delta(0, format='%Y-%m-%d') }}"```
However this does not allow me to backfill data beyond the date i start running the connector.
is there a way to loop the request from a start date on a daily granularity?
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1706037383610969) if you want to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["backfilling-daily-data", "cumulative-data", "connector-builder", "api", "daily-granularity"]
</sub>