Pipedrive Connector Data Limitation Issue

Summary

User reports missing data in Airbyte from the Pipedrive connector due to the recents endpoint’s limitation of pulling only a month’s worth of data. They inquire about contacting contributors for potential source refactor.


Question

Hi,
I’m using Airbyte OSS to pull deals and activities from Pipedive, and the connector uses the https://developers.pipedrive.com/docs/api/v1/Recents#getRecents|recents endpoint for most of the streams. I checked <https://developers.pipedrive.com/changelog/post/breaking-change-added-limit-to-the-since-timestamp-parameter|Pipedrive’s Changelog> after noticing missing data in my stream tables, and it looks like the endpoint would only pull a month’s worth of data. So if I’m syncing in full refresh, I won’t get all my data. This has been effective since the 1st of this month. Who should I contact regarding this? Do the contributors plan to refactor the source?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['pipedrive', 'connector', 'missing-data', 'recents-endpoint', 'data-limitation']