Error Creating Connection via Airbyte API

Slack Knowledge Base Q&A API, Terraform and Other Topics
, , , ,
1

Summary

User encounters a 400 error when attempting to create a connection using the Airbyte API with custom source and destination. The error message indicates a value could not be found, despite successful creation of the connection via the UI. The issue appears to be related to the custom destination when used with specific configurations.


Question

Hello
I am facing an error while using the Airbyte API for creating a connection.

I have created custom airbyte destination - destination-lamatic and a custom airbyte source - source-lamatic-google-drive. After creating a source and destination, I am trying to create a connection with their sourceId and destination Id using the following request:
POST: <http://64.23.188.17:8006/v1/connections>

    "configurations": {
        "streams": [
            {
                "name": "My Stream",
                "syncMode": "full_refresh_overwrite",
                "cursorField": [
                    "_ab_source_file_last_modified"
                ],
                "primaryKey": [
                    [
                        "document_key"
                    ]
                ]
            }
        ]
    },
    "schedule": {
        "scheduleType": "cron",
        "cronExpression": "0 0 * * * ?"
    },
    "sourceId": "5d05dc7d-0cfc-4912-9c56-be803808ac8d",
    "destinationId": "f11215b6-c725-4939-9f18-06dcfb508ea9",
    "name": "Temp-connection"
}```
This is giving the following error:
```{
    "detail": "Submitted value could not be found: null",
    "type": "<https://reference.airbyte.com/reference/errors>",
    "title": "value-not-found",
    "status": 400
}```
I am able to create the connection on the UI, however, I am getting this error when I try this with the API.

When I remove the configurations from the body, and send the request with the rest of the body, the connection is created successfully.

I also checked if there is an issue with the source or the destination created. When I tried to create a connection with my custom source, the connection request is working fine. However, when I try creating a connection with another source, and my custom created destination, I am still getting the error. There seems to be some error with creating a connection with the custom created destination.
And this issue only appears, when I am creating the source with the api and not on the UI.

I am sure that the sourceId, destinationId, and the stream name along with the sync modes are accurate as per my configurations.

I have gone through a lot of other issues created with a similar error, however, I haven't found any answer that solves the issue.
Any help regarding this would be greatly appreciated.

Thanks!

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1718340519939249) if you want
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
['airbyte-api', 'connection-creation', 'custom-destination', 'error-400', 'value-not-found']
</sub>