Creating Connector Stream in YAML Configuration

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

The user is facing an error while trying to create a connector stream in the YAML configuration. The error indicates that a valid manifest should have at least one stream defined.


Question

Hello :wave::skin-tone-2:

I’m trying to create my own connector but I don’t get the stream idea.

My YAML looks like this :

version: ‘1.0’

sync:
streams:
- name: test
sync_mode: full_refresh
destination_sync_mode: overwrite
frequency: daily

source:
name: AS400 DB2
connector: airbyte/source-custom-db2
configuration:
ssl: false
schema: acm
jdbc_url: jdbc:as400://111.22.333.44;librairies=acm
password: MyUserPassword
username: MyUser
driver_path: /tmp/airbyte_local/jt400.jar
driver_class: com.ibm.as400.access.AS400JDBCDriver

But the error I have is :

Error handling request: A valid manifest should have at least one stream defined. Got None

I don’t understand how to correctly create the stream


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["creating-connector", "yaml-configuration", "connector-stream", "error", "manifest"]
2

Manifest updated to this :

version: “0.1.0”
definitions: {}
streams:

  • name: Ikos

    Define the schema of the data and how to read it from the database.

    schema:
    type: object
    properties:
    column1:
    type: string
    column2:
    type: integer
    # Add more columns as needed
    retriever:
    type: “CustomRetriever”
    config:
    retriever_type: “SimpleRetriever”
    table_name: “my_table”
    read:

    Define how to read data from the database.

    sql: “SELECT * FROM my_table”
    check:

Define how to test the connection to the database.

type: CheckStream
stream_names:
- Ikos
connection:
sql: “SELECT 1 FROM SYSIBM.SYSDUMMY1”
spec:

Define the required and optional parameters for configuring the connector.

connection_specification:
type: object
required:
- jdbc_url
- username
- password
- driver_class
- driver_path
- schema
- ssl
properties:
jdbc_url:
type: string
description: “JDBC URL for the AS400 database”
default: “jdbc:as400://myserverip;librairies=mydatabase”
username:
type: string
description: “Username for the AS400 database”
default: “myusername”
password:
type: string
description: “Password for the AS400 database”
default: “mypassword”
driver_class:
type: string
description: “JDBC driver class for the AS400 database”
default: “com.ibm.as400.access.AS400JDBCDriver”
driver_path:
type: string
description: “Path to the JDBC driver jar file”
default: “/tmp/airbyte_local/jt400.jar”
schema:
type: string
description: “Schema to use in the AS400 database”
default: “mydatabase”
ssl:
type: boolean
description: “Use SSL for the connection”
default: false

But still doesn’t work. The retriever seems not to be good