DBT transformation working but Connection failing

  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Ubuntu
  • Memory / Disk: 8gb
  • Deployment: Docker
    Airbyte Version: 0.39.7-alpha
    Source: File (0.2.10)
    Destination: Snowflake (0.4.26)
  • Step: The issue is happening during sync
  • Description:

I have a connection loading csv files from sftp server to snowflake that is working. I want to add a dbt transformation after the load. My dbt repo is hosted on azure devops. It seems that evry thing is alright, I can see my transformation triggered in snowflake but the sync show a failed status

logs-1831.txt (97.5 KB)

Can you upgrade to latest version Lopez. I saw the error:

2022-06-06 12:34:11 e[1;31mERRORe[m i.a.w.g.DefaultReplicationWorker(run):180 - Sync worker failed.java.util.concurrent.ExecutionException: java.lang.RuntimeException: java.lang.NullPointerException: Cannot invoke "com.fasterxml.jackson.databind.node.ObjectNode.put(String, String)" because "matchingSchema" is null	at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:396) ~[?:?]	at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:2073) ~[?:?]	at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:173) ~[io.airbyte-airbyte-workers-0.39.7-alpha.jar:?]	at io.airbyte.workers.general.DefaultReplicationWorker.run(DefaultReplicationWorker.java:65) ~[io.airbyte-airbyte-workers-0.39.7-alpha.jar:?]	at io.airbyte.workers.temporal.TemporalAttemptExecution.lambda$getWorkerThread$2(TemporalAttemptExecution.java:158) ~[io.airbyte-airbyte-workers-0.39.7-alpha.jar:?]	at java.lang.Thread.run(Thread.java:833) [?:?]Caused by: java.lang.RuntimeException: java.lang.NullPointerException: Cannot invoke "com.fasterxml.jackson.databind.node.ObjectNode.put(String, String)" because "matchingSchema" is null	at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:382) ~[io.airbyte-airbyte-workers-0.39.7-alpha.jar:?]	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]	... 1 moreCaused by: java.lang.NullPointerException: Cannot invoke "com.fasterxml.jackson.databind.node.ObjectNode.put(String, String)" because "matchingSchema" is null	at io.airbyte.workers.RecordSchemaValidator.validateSchema(RecordSchemaValidator.java:51) ~[io.airbyte-airbyte-workers-0.39.7-alpha.jar:?]	at io.airbyte.workers.general.DefaultReplicationWorker.lambda$getReplicationRunnable$6(DefaultReplicationWorker.java:316) ~[io.airbyte-airbyte-workers-0.39.7-alpha.jar:?]	at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1136) ~[?:?]	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635) ~[?:?]	... 1 more

which was solved from patch 0.39.13-alpha

Hi MArco,

It works with proposed upgrade.

Thx & Have a nice day