Normalization error while uploading data in bigquery

Connector Questions & Issues
, ,
1
  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: Ubuntu
  • Memory / Disk: you can use something like 16Gb / 500GB
  • Deployment: Docker
  • Airbyte Version: 0.39.1-alpha
  • Source name/version:
  • Destination name/version: BigQuery
  • Step: Normalization
  • Description: I am following this blog for the setup => Set up a modern data stack with Docker 
2022-06-12 12:01:25 INFO () LineGobbler(voidCall):85 - Checking if airbyte/source-file:0.2.5 exists...`
`2022-06-12 12:01:25 INFO () LineGobbler(voidCall):85 - airbyte/source-file:0.2.5 was found locally.`
`2022-06-12 12:01:25 INFO () DockerProcessFactory(create):146 - Preparing command: docker run --rm --init -i -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -w /data/521b7c45-1986-42f8-9c25-33da4065a20b/0 --network host --log-driver none airbyte/source-file:0.2.5 check --config source_config.json`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 - Traceback (most recent call last):`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/bin/base-python", line 8, in <module>`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -     sys.exit(main())`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/base_python/entrypoint.py", line 135, in main`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -     launch(source, sys.argv[1:])`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/base_python/entrypoint.py", line 120, in launch`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -     AirbyteEntrypoint(source).start(args)`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/base_python/entrypoint.py", line 90, in start`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -     raw_config = self.source.read_config(parsed_args.config)`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -   File "/usr/local/lib/python3.7/site-packages/base_python/integration.py", line 60, in read_config`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 -     with open(config_path, "r") as file:`
`2022-06-12 12:01:29 ERROR () LineGobbler(voidCall):85 - FileNotFoundError: [Errno 2] No such file or directory: 'source_config.json'`
`2022-06-12 12:01:29 INFO () TemporalAttemptExecution(lambda$getWorkerThread$2):149 - Completing future exceptionally...`
`io.airbyte.workers.WorkerException: Error while getting checking connection.`

Getting this error while uploading file in the source tab. Kindly help.

2

Hey @ImDPS,
Do you confirm that you are trying to use a local file named source_config.json ?
You should store your file in your WORKSPACE_ROOT on your host to make sure it’s available for the connector:
/tmp/airbyte_local/source_config.json on your host
And use /local/source_config.json in the URL setting of the connector.

3

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.