Can someone explain the stream_slice method in the following use case. I want to run a sync starting at Jan/01/2020 until today, but save the syncs save by day. I want to know if read_records can continue to be called until the sync is caught up to today, then when its caught up, just run 1 day. Is this a use of stream_slice?
For this you need to implement incremental streams where they will output states and the next run knows from where to start https://docs.airbyte.com/connector-development/cdk-python/incremental-stream
Stream Slices are useful to large requests where you want to break them, or for nested streams
Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.