Issue with Databricks destination v3.3.0 incremental sync

Summary

Error occurs on subsequent incremental syncs with Databricks destination v3.3.0, getting TABLE_OR_VIEW_ALREADY_EXISTS error. Similar issue was fixed before, but this might be a different case.


Question

Hi, we’ve got an issue with the databricks destination v3.3.0. We set up an incremental sync for a table from a postgres source into databricks with unity catalog. It succeeds for the first sync, but on subsequent (incremental) syncs, we get a TABLE_OR_VIEW_ALREADY_EXISTS error. We’ve seen a similar thread https://airbytehq.slack.com/archives/C07QGDKNQ9F/p1723675851807649|here that was apparently fixed, so maybe it’s not the exact same issue. Will post more of the error in the thread. Any help would be appreciated, as it’s currently stopping us from being able to sync data! Thanks in advance



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["databricks-destination", "incremental-sync", "postgres-source", "unity-catalog", "TABLE_OR_VIEW_ALREADY_EXISTS"]