PostgreSQL CDC publication error

Summary

Error encountered when trying to activate a publication for all tables in PostgreSQL CDC connection. Error message indicates publication does not exist.


Question

Hello everyone,
I have a PostgreSQL CDC connection with some ingestion tables. In my PostgreSQL database, I initially had a publication for four tables. Now, I need to activate the publication for all tables. To do this, I disabled the ingestion, excluded the previous publication, and recreated it with the same name for all tables: CREATE PUBLICATION airbyte_prd_msce_slot FOR ALL TABLES;

However, I received the following ingestion error: Caused by: org.postgresql.util.PSQLException: ERROR: publication "airbyte_publication" does not exist.

When I reset all data, it works, but I don’t want to do this. Is there any way to resolve this issue without resetting all the data?

Versions:
PostgreSQL: 12.17
AirbytePostgresConnector: 3.4.20



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["postgresql-cdc", "publication-error", "airbytepostgresconnector", "postgresql-12.17"]

Hey <@U07C35JAT9S> - any reason you can’t update the current publication with new tables in these scenarios? i.e. just add the missing tables to airbyte_publication? This should avoid needing to reset any existing streams

<@U03AM8G2WHG> I wanted to use the command “FOR ALL TABLES;”, but it doesn’t work with the current publication. PostgreSQL does not permit this modification.