Error syncing MSSQL to Postgres with Airbyte 0.63.1

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Encountered a sync failure when syncing MSSQL to Postgres using Airbyte 0.63.1. The error message indicates an issue with deserializing PartialAirbyteMessage. Logs show errors related to space allocation in MSSQL. Similar issues were reported with Snowflake, which were fixed in the latest connector version.


Question

Hi everyone, encountered following issue when syncing MSSQL to Postgres. Airbyte 0.63.1 with
Postgres v2.0.12 and Microsoft SQL Server (MSSQL) v4.0.30 connectors.


723.89 MB
|
27,426 records extracted
|
no records loaded
|
52m 15s
Warning from destination: Something went wrong in the connector. See the logs for more details. 
See less

java.lang.RuntimeException: Unable to deserialize PartialAirbyteMessage.```
The only errors I could find in logs are
```2024-07-01 12:29:32 [44msource[0m > WARN main i.a.i.s.m.MssqlQueryUtils(lambda$getTableSizeInfoForStreams$6):165 Error occurred while attempting to estimate sync size com.microsoft.sqlserver.jdbc.SQLServerException: Objects of this type have no space allocated.
	at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:261) ~[mssql-jdbc-12.6.1.jre11.jar:?]```
and
```Stack Trace: com.microsoft.sqlserver.jdbc.SQLServerException: Objects of this type have no space allocated.
	at com.microsoft.sqlserver.jdbc.SQLServerException.makeFromDatabaseError(SQLServerException.java:261)```
Noticed users had similar issues with Snowflake. where a fix was included with the newest version of the connector.

added container logs below:
```2024-07-01 13:20:26 INFO i.a.c.s.h.JobsHandler(reportIfLastFailedAttempt):149 - Successfully reported failure for job id '37' connectionId: 'cf24c7c4-e7a1-4017-8ed5-762c1ce57a40'
2024-07-01 13:20:26 INFO i.a.v.j.JsonSchemaValidator(test):121 - JSON schema validation failed.
errors: $.ssl_method: must be a constant value unencrypted
2024-07-01 13:20:26 INFO i.a.v.j.JsonSchemaValidator(test):121 - JSON schema validation failed.
errors: $.method: must be a constant value CDC
2024-07-01 13:20:26 INFO i.a.v.j.JsonSchemaValidator(test):121 - JSON schema validation failed.```

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1719848079589399) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["sync-failure", "mssql-connector", "postgres-connector", "airbyte-0.63.1", "deserialization-error", "space-allocation-error", "snowflake-issue"]
</sub>