Setting stream cursor to specific point of time for sync

[slack-user-airbyte]

Summary

This user is asking if there is a way to set the stream cursor to a specific point of time to start the sync from a recent date instead of syncing the entire table. They couldn’t find a solution in the documentation or forums and are curious if others have encountered this situation.

Question

Hey peeps,

Is there a way to set the stream cursor to certain point of time to start the sync from recent date rather syncing the whole huge table? I couldn’t find any proper solution in the doc and in the forums.

I’m not sure this feature is still being worked on, but want to know if anyone had come across this situation before? Thanks

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

_{["stream-cursor", "sync", "specific-point-of-time", "connector"]}

[slack-user-airbyte]

i actually tried with Connection state config, but nothing is synced at all. is there anything wrong with the config?

  "streamStates": [
    {
      "streamDescriptor": {
        "name": "some_table",
        "namespace": "acme"
      },
      "streamState": {
        "stream_name": "some_table",
        "cursor": "1704070800",
        "cursor_field": [
          "updatedAt"
        ],
        "stream_namespace": "acme"
      }
    }
  ]
}```
airbyte: v0.50.35
sync: mysql -> postgres
connecter versions: mysql (3.3.2) -> postgres (3.3.1)