Error creating connection with custom Airbyte source and destination using API

Slack Knowledge Base Q&A API, Terraform and Other Topics
, , , ,
1

Summary

The user is facing an error when trying to create a connection with custom Airbyte source and destination using the API. The error message indicates a ‘value-not-found’ issue with the submitted value.


Question

Hello
I am facing an error while using the Airbyte API for creating a connection.

I have created custom airbyte destination - destination-lamatic and a custom airbyte source - source-lamatic-google-drive. After creating a source and destination, I am trying to create a connection with their sourceId and destination Id using the following request:
POST: <http://64.23.188.17:8006/v1/connections>

    "configurations": {
        "streams": [
            {
                "name": "My Stream",
                "syncMode": "full_refresh_overwrite",
                "cursorField": [
                    "_ab_source_file_last_modified"
                ],
                "primaryKey": [
                    [
                        "document_key"
                    ]
                ]
            }
        ]
    },
    "schedule": {
        "scheduleType": "cron",
        "cronExpression": "0 0 * * * ?"
    },
    "sourceId": "5d05dc7d-0cfc-4912-9c56-be803808ac8d",
    "destinationId": "f11215b6-c725-4939-9f18-06dcfb508ea9",
    "name": "Temp-connection"
}```
This is giving the following error:
```{
    "detail": "Submitted value could not be found: null",
    "type": "<https://reference.airbyte.com/reference/errors>",
    "title": "value-not-found",
    "status": 400
}```
I am able to create the connection on the UI, however, I am getting this error when I try this with the API.

When I remove the configurations from the body, and send the request with the rest of the body, the connection is created successfully.

I also checked if there is an issue with the source or the destination created. When I tried to create a connection with my custom source, the connection request is working fine. However, when I try creating a connection with another source, and my custom created destination, I am still getting the error. There seems to be some error with creating a connection with the custom created destination.
And this issue only appears, when I am creating the source with the api and not on the UI.

I am sure that the sourceId, destinationId, and the stream name along with the sync modes are accurate as per my configurations.

I have gone through a lot of other issues created with a similar error, however, I haven't found any answer that solves the issue.
Any help regarding this would be greatly appreciated.

Thanks!

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1718191669844389) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["airbyte-api", "custom-source", "custom-destination", "connection-error", "value-not-found"]
</sub>
2

I am using the id of the source and the destination connectors created for creating the connection (not the definitionId)

3

<@U01MMSDJGC9> Is there any possible solution to fix this?

4

Are you using the source definition id or the id from a the source connector created?