HubSpot deal_pipelines endpoint missing rows on sync

  • Is this your first time deploying Airbyte: No
  • OS Version / Instance: GCP, e2-medium running Debian-10
  • Memory / Disk: -
  • Deployment: Docker
  • Airbyte Version: 0.35.31-alpha
  • Source name/version: Hubspot 1.51 (I have also tried other earlier versions: 0.1.7 & 0.1.33)
  • Destination name/version: BigQuery 0.6.8
  • Step: When syncing deal_pipelines
  • Description: When syncing deal_pipelines from Hubspot, Airbyte can only find the final record and send it to the destination even though I know there are more records in deal_pipeline.
    This is definitely an issue with the source connection as the logs report Total records read: 1 .
    I have also tried manually connecting to the API endpoint (https://api.hubapi.com/crm-pipelines/v1/pipelines/deals) using the requests library in Python and the response includes all the details. I’m not sure what is going on and what the issue is, but perhaps it is a problem with how the schema is generated.
    Any help would be much appreciated!

I’m using our integration account and was able to get 2 records for deal_pipelines.

Are you using API key access or OAuth? The implementation of the stream is following the basic one. Can you make sure the start date is correct?

Thank you, it was the start date that was too recent. I wasn’t looking far enough back :slight_smile:

Hi there from the Community Assistance team.
We’re letting you know about an issue we discovered with the back-end process we use to handle topics and responses on the forum. If you experienced a situation where you posted the last message in a topic that did not receive any further replies, please open a new topic to continue the discussion. In addition, if you’re having a problem and find a closed topic on the subject, go ahead and open a new topic on it and we’ll follow up with you. We apologize for the inconvenience, and appreciate your willingness to work with us to provide a supportive community.