Postgres Failure to Sync

  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: GKE Deployed via Helm
  • Memory / Disk: n/a
  • Deployment: Kubernetes
  • Airbyte Version: 0.38.3-alpha
  • Source name/version: Postgres 0.4.16
  • Destination name/version: BigQuery 1.1.6
  • Step: Sync
  • Description: I’m getting a schema validation error “null found, expected string”. However it is expected that there may be null values in the database for these fields.
2022-05-24 23:33:42 e[33mWARNe[m i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):298 - Record schema validation failed. Errors: json schema validation failed when comparing the data to the json schema. 
Errors: $.dtmf_id: null found, string expected, $.flags: null found, array expected, $.agreements: null found, string expected, $.deleted_at: null found, string expected, $.balance_minutes: null found, number expected, $.payment_methods: null found, string expected, $.stripe_customer_id: null found, string expected, $.subscribed_package_config: null found, string expected, $.organization_id: null found, string expected, $.subscribed_package_id: null found, string expected, $.autoreload_package_id: null found, string expected, $.braintree_customer_id: null found, string expected 
Schema: 
{
  "type" : "object",
  "properties" : {
    "id" : {
      "type" : "string"
    },
    "flags" : {
      "type" : "array"
    },
    "dtmf_id" : {
      "type" : "string"
    },
    "user_id" : {
      "type" : "string"
    },
    "agreements" : {
      "type" : "string"
    },
    "created_at" : {
      "type" : "string"
    },
    "deleted_at" : {
      "type" : "string"
    },
    "modified_at" : {
      "type" : "string"
    },
    "account_config" : {
      "type" : "string"
    },
    "balance_minutes" : {
      "type" : "number"
    },
    "organization_id" : {
      "type" : "string"
    },
    "payment_methods" : {
      "type" : "string"
    },
    "stripe_customer_id" : {
      "type" : "string"
    },
    "currency_preference" : {
      "type" : "string"
    },
    "subscription_config" : {
      "type" : "string"
    },
    "autoreload_package_id" : {
      "type" : "string"
    },
    "braintree_customer_id" : {
      "type" : "string"
    },
    "subscribed_package_id" : {
      "type" : "string"
    },
    "subscribed_package_config" : {
      "type" : "string"
    }
  },
  "$schema" : "http://json-schema.org/draft-07/schema#"
}

What version of Airbyte and connectors are you using?

I’m pretty sure I filled out the template but it’s these

Sorry to ask you, we use Zendesk in our support and it doesn’t update sometimes :sweat_smile:.
Could you upgrade to latest version? Looks the version 0.38.4 already solved the issue: https://github.com/airbytehq/airbyte/pull/12875
Will print one time but not for every record. Also the team is working harder about the schema validation

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.