Troubleshooting connection failures

Summary

Explore ways to investigate and resolve connection failures with more detailed error messages.


Question

Hello everyone,

All of my connections failed because of the same error. Is there a way to dig deeper ? The message is not very explicit.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["troubleshooting", "connection-failures", "error-message", "investigate"]

And the sources are working

The best way is to look in the logs, both in the UI as well as the containers around the time it failed (either using your platform’s logging or docker container logs)

Hey <@U035912NS77>,

This is the errors I get on all my jobs :

2024-03-23 12:00:03 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "WARN StatusConsoleListener The use of package scanning to locate plugins is deprecated and will be removed in a future release"
2024-03-23 12:00:03 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "WARN StatusConsoleListener The use of package scanning to locate plugins is deprecated and will be removed in a future release"
2024-03-23 12:00:03 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "WARN StatusConsoleListener The use of package scanning to locate plugins is deprecated and will be removed in a future release"
2024-03-23 12:00:03 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:03 \u001B[32mINFO\u001B[m i.a.i.d.p.PostgresDestination(main):128 - starting destination: class io.airbyte.integrations.destination.postgres.PostgresDestination"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.b.IntegrationCliParser(parseOptions):126 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.b.IntegrationRunner(runInternal):132 - Running integration: io.airbyte.cdk.integrations.base.ssh.SshWrappedDestination"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.b.IntegrationRunner(runInternal):133 - Command: WRITE"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.b.IntegrationRunner(runInternal):134 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):278 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):278 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2024-03-23 12:00:04 source &gt; Starting syncing SourceHubspot
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.b.s.SshWrappedDestination(getSerializedMessageConsumer):107 - No SSH connection options found, using defaults"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.b.s.SshTunnel(getInstance):252 - Starting connection with method: NO_TUNNEL"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m c.z.h.HikariDataSource(&lt;init&gt;):80 - HikariPool-1 - Starting..."
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m c.z.h.HikariDataSource(&lt;init&gt;):82 - HikariPool-1 - Start completed."
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=campaigns, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_fgf_campaigns, outputTableName=_airbyte_raw_campaigns, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=companies, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_icj_companies, outputTableName=_airbyte_raw_companies, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=contact_lists, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_eqw_contact_lists, outputTableName=_airbyte_raw_contact_lists, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=contacts, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_hcp_contacts, outputTableName=_airbyte_raw_contacts, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=contacts_form_submissions, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_buu_contacts_form_submissions, outputTableName=_airbyte_raw_contacts_form_submissions, syncMode=overwrite}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=deal_pipelines, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_zsm_deal_pipelines, outputTableName=_airbyte_raw_deal_pipelines, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=deals, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_lpq_deals, outputTableName=_airbyte_raw_deals, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=deals_archived, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_tzw_deals_archived, outputTableName=_airbyte_raw_deals_archived, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=email_events, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_dop_email_events, outputTableName=_airbyte_raw_email_events, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=engagements, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_cdy_engagements, outputTableName=_airbyte_raw_engagements, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=engagements_calls, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_yfr_engagements_calls, outputTableName=_airbyte_raw_engagements_calls, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=engagements_emails, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_zly_engagements_emails, outputTableName=_airbyte_raw_engagements_emails, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=engagements_meetings, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_rxl_engagements_meetings, outputTableName=_airbyte_raw_engagements_meetings, syncMode=append_dedup}"
2024-03-23 12:00:04 ERROR i.a.w.i.VersionedAirbyteStreamFactory(toAirbyteMessage):360 - Deserialization failed: "2024-03-23 12:00:04 \u001B[32mINFO\u001B[m i.a.c.i.d.j.JdbcBufferedConsumerFactory(lambda$toWriteConfig$0):122 - Write config: WriteConfig{streamName=engagements_notes, namespace=hubspot, outputSchemaName=hubspot, tmpTableName=_airbyte_tmp_pqx_engagements_notes, outputTableName=_airbyte_raw_engagements_notes, syncMode=append_dedup}"```
It began to happen 2 days ago, any idea on the possible cause for this ? We did not touch anything.

Is this a normal Airbyte source (if so, which?) or a custom one? And what version of Airbyte are you on?

It does it for all of our sources :

• Hubspot (certified, version 4.2.13)
• Jira (certified, version 3.0.10)
• Gitlab (certified, version 4.2.1)
• Younium (community, version 0.3.10)
We are on version 0.57.2, and the destination is Postgres (connector version 2.2.1)