Multiple streams of the same type(class) in one source connector

Connector Development
#1

I am working on a source connector for getting stock data from Yahoo Finance. Since in most use-cases data would need to be collected for tens of hundreds of stocks it would be in-efficient to have a connector for every individual stock.

I would like to d this:

    def streams(self, config: Mapping[str, Any]) -> List[Stream]:
        return [Ticker(ticker=ticker for ticker in config["ticker"])]

But Airbyte only returns one stream.
How can/should I do this?

#2

I have encountered the same problem. Has the problem been solved? I look forward to your reply

#4

Hey can you try something similar to this below https://github.com/airbytehq/airbyte/blob/b8703ea6a113bc3c4fd4fe7d309802ca8632673f/airbyte-integrations/connectors/source-marketo/source_marketo/source.py#L522