Postgres Failure to Sync

Connector Questions & Issues
,
1
  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: GKE Deployed via Helm
  • Memory / Disk: n/a
  • Deployment: Kubernetes
  • Airbyte Version: 0.38.3-alpha
  • Source name/version: Postgres 0.4.16
  • Destination name/version: BigQuery 1.1.6
  • Step: Sync
  • Description: I’m getting a schema validation error “null found, expected string”. However it is expected that there may be null values in the database for these fields.
2022-05-24 23:33:42 e[33mWARNe[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):298 - Record schema validation failed. Errors: json schema validation failed when comparing the data to the json schema. 
Errors: $.dtmf_id: null found, string expected, $.flags: null found, array expected, $.agreements: null found, string expected, $.deleted_at: null found, string expected, $.balance_minutes: null found, number expected, $.payment_methods: null found, string expected, $.stripe_customer_id: null found, string expected, $.subscribed_package_config: null found, string expected, $.organization_id: null found, string expected, $.subscribed_package_id: null found, string expected, $.autoreload_package_id: null found, string expected, $.braintree_customer_id: null found, string expected 
Schema: 
{
  "type" : "object",
  "properties" : {
    "id" : {
      "type" : "string"
    },
    "flags" : {
      "type" : "array"
    },
    "dtmf_id" : {
      "type" : "string"
    },
    "user_id" : {
      "type" : "string"
    },
    "agreements" : {
      "type" : "string"
    },
    "created_at" : {
      "type" : "string"
    },
    "deleted_at" : {
      "type" : "string"
    },
    "modified_at" : {
      "type" : "string"
    },
    "account_config" : {
      "type" : "string"
    },
    "balance_minutes" : {
      "type" : "number"
    },
    "organization_id" : {
      "type" : "string"
    },
    "payment_methods" : {
      "type" : "string"
    },
    "stripe_customer_id" : {
      "type" : "string"
    },
    "currency_preference" : {
      "type" : "string"
    },
    "subscription_config" : {
      "type" : "string"
    },
    "autoreload_package_id" : {
      "type" : "string"
    },
    "braintree_customer_id" : {
      "type" : "string"
    },
    "subscribed_package_id" : {
      "type" : "string"
    },
    "subscribed_package_config" : {
      "type" : "string"
    }
  },
  "$schema" : "http://json-schema.org/draft-07/schema#"
}
2

What version of Airbyte and connectors are you using?

3

I’m pretty sure I filled out the template but it’s these

4

Sorry to ask you, we use Zendesk in our support and it doesn’t update sometimes :sweat_smile:.
Could you upgrade to latest version? Looks the version 0.38.4 already solved the issue: https://github.com/airbytehq/airbyte/pull/12875
Will print one time but not for every record. Also the team is working harder about the schema validation

5

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.