Python custom source build - Internal Server Error: Get Spec job failed

Connector Development
1
  • Is this your first time deploying Airbyte?: Yes
  • OS Version / Instance: Windows
  • Memory / Disk: 32Gb / 2 Tb
  • Deployment: Are you using Docker or Kubernetes deployment? Yes
  • Airbyte Version: latest
  • Source name/version: google ads
  • Step: The issue is happening during creating the connection or a new source?
  • Description:
    Hi.

I`ve built a new source and followed step by step with this video :

and this doc:

As described in the video and docs - Ive passed all the tests and ran the docker build command and when I go to the UI to try to add the new connector Im getting this error:

Internal Server Error: Get Spec job failed.

Im not sure why Im getting this error since I`ve passed all the tests i.e. the check, discover and read.

These are the test commands:
py -m main check --config sample_files/config.json
py -m main discover --config sample_files/config.json
py -m main read --config sample_files/config.json --catalog sample_files/configured_catalog.json

This is the build command:
docker build . -t airbyte/source-my-new-source:dev

What am I missing?

Thank you.

2

For future reference - found a solution.
Used docker logs container_name (the airbyte server) for the logs -saw it says no module x found so went to setup.py and fixed the requirements in that file.
Added in airbyte-config\init\src\main\resources\seed\source_definitions.yaml
logic for the image i.e. MAIN_REQUIREMENTS
also in
airbyte-config\init\src\main\resources\seed\source_specs.yaml
added the logic needed for the UI for the image
also
made sure that Dockerfile is the same logic as other connectors and built on top of that

the docs nor the video are correct for python source

1 Like