Summary
Moving from a locally hosted Airbyte instance to the SAAS instance on airbyte.com and looking to keep cursor points for data sources from Shopify to avoid re-fetching entire data source
Question
Hello everyone,
I am moving from a locally hosted Airbyte instance to the SAAS instance on http://airbyte.com|airbyte.com as maintenance is time consuming; I have a few data sources that ingest from Shopify and ideally I would like to keep the cursor points at date and switch them in place; is this possible to do or will I need to re-fetch the entire data source again? At the moment they are storing the data in GCS
Thanks!
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.
Join the conversation on Slack
["moving", "saas-instance", "cursor-points", "data-sources", "shopify", "gcs"]
Can you edit Connection state on Settings page in SAAS instance on http://airbyte.com|airbyte.com? If so, you can copy state from your locally hosted Airbyte instance.
Yeah, I can do that; can I also edit that on the SAAS instance before setting up the connection?
I am afraid that after I set up the connection it will start dumping data in straight away
When creating new connection you can set Schedule type to Manual.
If you’d use terraform, then it’s even possible to set status = "inactive"
https://registry.terraform.io/providers/airbytehq/airbyte/latest/docs/resources/connection
One last question, what happens if the shopify schema changed since then?
e.g. if they added new columns?
Could I also protect it from using the new schema instead of the old?
And as always, take a backup before you run the first Cloud sync just to be safe 
Thanks everyone, it all worked fine!