Issue with source MSSQL (not solved)

  • Is this your first time deploying Airbyte?: Yes
  • Deployment: K8s
  • Airbyte Version: 0.35.65-alpha?
  • Source name/version: MSSQL Server
  • Destination name/version: S3
  • Output Format: Avro
  • Step: During sync
  • Description: Errors related to JSON schema validation and compression are thrown. For example, “errors: $.compression_level: is missing but it is required, $.codec: does not have a value in the enumeration [xz]”
    logs-456.txt (4.0 MB)

@CrLough sorry the long delay. Do you still need help here?

I got a similar error with the following configs :

  • Is this your first time deploying Airbyte?: Yes
  • Deployment: K8s
  • Airbyte Version: 0.35.65-alpha?
  • Source name/version: MSSQL Server
  • Destination name/version: S3
  • Output Format: Parquet
    *Compression Codec: GZIP
  • Step: at the end of the sync (50M row = 60GB) , the data was synced but got this error :
    errors: $.flattening: is missing but it is required, $.format_type: does not have a value in the enumeration [CSV]
    2022-04-17 06:02:04 INFO i.a.v.j.JsonSchemaValidator(test):56 - JSON schema validation failed.
    errors: $.format_type: does not have a value in the enumeration [JSONL]

Noureddine Khelifaoui please create a new topic and post the complete log file to debugging. This message is a warning (the team is working to correct the debugging level of this).

Topic close because was not possible to identify root cause.