Recommended values and env vars for syncing issues in Airbyte to BigQuery

Slack Knowledge Base Q&A Platform Questions
, , , ,
1

Summary

The user is experiencing issues with syncing data to BigQuery in Airbyte, specifically mentioning that not all tables are loaded. They are seeking advice on the recommended values and environment variables to set.


Question

Hi everyone

We have some issues with syncing and not all tables loaded to BQ
Could you pls advise on the recommended values and env vars to set?

have a good day and thank you in advance

airbyte-server  | 2024-06-13 09:25:09 INFO i.a.c.s.h.h.StatsAggregationHelper(lambda$hydrateWithAggregatedStats$6):197 - No stats have been persisted for job 6 stream StreamNameAndNamespace[name=ads_insights_action_video_type, namespace=null].
airbyte-server  | 2024-06-13 09:25:09 INFO i.a.c.s.h.h.StatsAggregationHelper(lambda$hydrateWithAggregatedStats$6):197 - No stats have been persisted for job 6 stream StreamNameAndNamespace[name=ads_insights_demographics_gender, namespace=null].
airbyte-server  | 2024-06-13 09:25:09 INFO i.m.h.s.n.h.a.e.AccessLog(log):125 - airbyte-webapp.airbyte_airbyte_internal - - [13/Jun/2024:09:25:07 +0000] "POST /api/v1/jobs/list HTTP/1.0" 200 987445
airbyte-server  | OpenJDK 64-Bit Server VM warning: INFO: os::commit_memory(0x00000006db000000, 1786773504, 0) failed; error='Not enough space' (errno=12)
airbyte-server  | #
airbyte-server  | # There is insufficient memory for the Java Runtime Environment to continue.
airbyte-server  | # Native memory allocation (mmap) failed to map 1786773504 bytes. Error detail: committing reserved memory.
airbyte-server  | # An error report file with more information is saved as:
airbyte-server  | # /app/hs_err_pid1.log
airbyte-server  | Unsetting empty environment variable 'JOB_ERROR_REPORTING_SENTRY_DSN'
airbyte-server  | Unsetting empty environment variable 'WORKER_ENVIRONMENT'
airbyte-server  | Unsetting empty environment variable 'DD_AGENT_HOST'```


<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1718274666752969) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["syncing-issues", "airbyte", "bigquery", "recommended-values", "env-vars"]
</sub>