I know there were similar questions asked, but the proposed answers don’t seem to help in my case.
I’ve developed a custom connector some time ago and now need to improve it. However, I can’t get it uploaded to my Airbyte instance. During the period between the last time I’ve got it working and now I’ve changed my PC I work on - this might be relevant. I’m now using M1 Mac.
What I did: first tried to copy a source folder to my local instance of Airbyte, create a docker image, push, update on my target Airbyte instance. Doesn’t work. I get the following unhelpful error:
“Get spec job failed.”
Ok, I then went through generator to create a new source, copied out all the code, schemas, specs etc. and did that carefully.
I then test it locally (through venv, command line) and it seems to work. I build a docker image, push it, and then try to update my connector - same error again.
Since the error seems to be absolutely generic (same error if I enter a random docker repo linking to a non-existing image), I’ve tried accessing server logs - no success, still some generic “unhandled exception” error.
One suspicious thing that I’ve noticed is that the current image is ±28 mb. while the old one used to be around ±37 - but I am an idiot what concerns Docker, so this doesn’t indicate to me anything particular.
Any ideas? THANKS!
P.S. What is NOT the case here:
- Image naming - no stacked folders in Docker repo, no “_” or other “bad” symbols
- Issues with actual specs - docker run --rm -i repo/image-name:tag spec goes through