Incremental parent stream with full-refresh child stream

Slack Knowledge Base Q&A Connector Development
, , , ,
1

Summary

workaround for setting up an incremental parent stream with a full-refresh child stream in Airbyte Cloud


Question

Incremental parent stream with full-refresh child stream
Hello :wave:
I have set up an incremental parent stream with a child that cannot be retrieved incrementally and I don’t want to query the api for each parent_id only the ones that were retrieved during incremental sync.
It seems that it is not yet available in the UI (https://github.com/airbytehq/airbyte/issues/28278). Is there a workaround to achieve this ?
(edit: we use airbyte cloud)


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["incremental-parent-stream", "full-refresh-child-stream", "workaround", "airbyte-cloud"]
2

It seems that the property use_cache : true on the parent stream allows to limit the requests in the child stream to the result of the current stream. Is it correct ? I tried to set up this property in the yml file but without success, can it be set in the yml ? if yes where ? thanks