Syncing Shopify Orders to Postgres 17 hanging at executeTypeAndDedupe step

Summary

The user is experiencing an issue where the sync of Shopify Orders to Postgres 17 is hanging at the executeTypeAndDedupe step, with the final table not receiving any rows. The query runs in pg_stat_activity for about 5 minutes then goes idle in transaction. The manual query does not error but also does not insert any rows from the source table.


Question

Hey folks, I am new to Airbyte and using the hosted service. Wondering if anyone had problems syncing Shopify (source) Orders (table) into Postgres 17 (destination). the sync is just running forever. The logs show data is loaded and pushed into the intermediate table in postgres and the last step executeTypeAndDedupe never finishes (it hangs at the first query insert into). As I understand this steps should copy the intermediate table to the final table (with correct schema and types). My final table never gets any rows inserted. I can see the query running in pg_stat_activity for about 5 mins then it is “idle in transaction”. I ran the query manually and it does not error but it also does not insert any rows, it somehow does not read any rows from the "airbyte_internal"."public_raw__stream_orders". Am I missing something here?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["syncing", "shopify-source", "postgres-17-destination", "executeTypeAndDedupe", "pg_stat_activity", "airbyte_internal", "public_raw__stream_orders"]