Setting up Linear integration with Airbyte Cloud without hosting own instance

Slack Knowledge Base Q&A Connector Questions
, , , ,
1

Summary

Exploring the possibility of setting up Linear integration with Airbyte Cloud without self-hosting based on a comment in the Airbyte GitHub repository.


Question

Has anyone set up a Linear integration with Airbyte Cloud? It looks like it may be possible to do in specific cases but not generally in the Airbyte UI based on the comment from <@U021B5LMCER> here: https://github.com/airbytehq/airbyte/issues/32744#issuecomment-2008377281. Wondering if there’s a way for me to set this up without hosting my own Airbyte instance.


This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["linear-integration", "airbyte-cloud", "self-hosting", "github-comment"]
2

Glad you asked! Which streams of data you want from Linear? I’ll try to publish the connector for you tonight or later this week.

3

Thanks <@U069EMNRPA4>! I’ll be extracting the data into an s3 bucket before it’s copied to the DW and I think I want all of the main object types. The only things I’d want to exclude are big tables with event/audit data, or big fields like the entire contents of attachments. But I’d like to keep as much of the metadata as possible. Is it possible for me to update the configuration after you turn it on so I can exclude some things but maybe turn them on later?

4

Hey <@U069EMNRPA4> just wanted to check in and see if we could get this set up soon

5

So, short version is yes, but I’d need your help.

We’ll do this as follows.

  1. We have a naive version of the connector that has a bunch of things, but does not have pagination. We will ship this as a manifest-only connectors in a couple days.
  2. You will then start an Airbyte Cloud trial (has to be cloud), go to Builder, and open that Linear connector.
    a. You’ll put in your testing values, i.e. the api token, project ids, etc
    b. You will ping me with the link to your connector, and a permission to impersonate you to add pagination and friends. You can skip this, if you want to add pagination things yourself! Should be straightforward.
  3. Once we or you add pagination and other polish, you will make a PR from Builder!
    a. We review, make sure your name is in the change-log to recognize your work, and merge.
    b. Boom, you have a full working connector, and everyone else does, too.
    /cc <@U02TNBMDUMQ> :upside_down_face:

Does that sound good?

6

<@U069EMNRPA4> sorry for the wait. I don’t mind contributing a bit, but what is the state of this connector? This would be the first one I use on Airbyte, but on other platforms I’ve tended to go with the officially supported connectors as the community ones often have problems out of the gate. Is this a connector that will be offiicially supported by Airbyte?

7

• I can give you some of my attention in the coming weeks to iron out the wrinkles in it initially. Looks like what we have is decent, but needs improvement in paginating.
◦ For that, we’d need to pull off the scheme above, otherwise I don’t have a live account to validate on.
• After that, we have a team of community engineers who support connectors. You won’t get Airbyte team fix bugs on Zendesk, but you get de-facto stuff fixed if there are problems.
◦ But, the manifest-only framework overall is pretty solid already, and Linear fully works on it.
• And then, I’ll go talk to Linear folks and ask them to replace their proprietary connector with our stuff in their docs, and perhaps help us support it — then we would call this a “Partner” certified connector.