How to update CDK?

Connector Development
1

Hi,

I’d like to use IncrementalMixin to create an incremental stream for one of my connectors. I am currently using an older version of the CDK which would not allow IncrementalMixin to be imported but I can see that that bug is now fixed in the latest version.

My question is simply how is it best for me to update the CDK without breaking any of my code for existing connectors?

Thanks for your help!

2

Hey when you build a new version image for the connector it should take the latest version of CDK.

You can check this by building a new local docker image and try running it as a custom connector.

Do reach out here if you need any help on the above mentioned steps

3

Thanks @harshith , just to check does building the new docker image also cause an update in the local files in the Airbyte folder on my local machine?

As I understand, the local files (e.g. those in airbyte/airbyte_cdk ) will need to be updated in order to run the python main.py read ... commands? (for example if I want to run python main.py read --config sample_files/config.json --catalog sample_files/configured_catalog.json)

4

Hey, you build the connector using docker and use it as a custom connector in the airbyte? Is this something doable?

5

Yes that’s doable. But I’m just wondering whether there is a way to update the local CDK files too.

The ability to use the main.py commands in the command line is a really useful part of the development process and having to build a docker image each time makes the dev process a lot less efficient.

To update the local files can I just replace the airbyte_cdk folder in my local machine with the latest one from GitHub, or is there an automated way to do it?

6

Hey yeah you can probably merge the latest master and that should take care of it

7

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.