Records not syncing in Hubspot connector

Summary

Some records are not syncing in the Hubspot connector without any apparent errors or reasons.


Question

Hi all, I noticed that some records are not being synced in my Hubspot connector I have set up, but I’m not sure why. There doesn’t seem to be any errors or reasons why these records aren’t present, as other records are syncing correctly.



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["records-not-syncing", "hubspot-connector", "data-sync", "errors"]

This is happening to all streams or a particular one?
Did you try to group by date or other property to find some relationship ?

I only have 1 stream enabled, so just that one- it appears to be happening across all days, but a lot of records on 1/17 in particular

-----------------------+-----+
2024-01-19 00:00:00.000|  164|
2024-01-18 00:00:00.000|   42|
2024-01-17 00:00:00.000|  543|
2024-01-16 00:00:00.000|   21|
2024-01-15 00:00:00.000|   21|
2024-01-14 00:00:00.000|   92|
2024-01-13 00:00:00.000|  136|
2024-01-12 00:00:00.000|    4|
2024-01-11 00:00:00.000|    3|
2024-01-10 00:00:00.000|   43|
2024-01-09 00:00:00.000|   83|
2024-01-08 00:00:00.000|  173|
2024-01-07 00:00:00.000|  115|
2024-01-06 00:00:00.000|  104|
2024-01-05 00:00:00.000|  101|
2024-01-04 00:00:00.000|  214|
2024-01-03 00:00:00.000|    5|
2024-01-02 00:00:00.000|   63|
2024-01-01 00:00:00.000|    1|```

Numbers were pretty low 10-50 records before January, now it’s in the 100s most days

<@U01MMSDJGC9> Is there anything I can do to see why these records aren’t syncing? I’m not seeing any helpful info in the logs

Probably the start is to try make the same request manually using Postman to compare results

Where can I see the exact request that Airbyte makes to hubspot for my particular stream?

<@U01MMSDJGC9> where can I find the endpoint used by Airbyte?

I’m retrieving the troublesome records just fine with the endpoint {{baseUrl}}/crm/v3/objects/companies/ on Postman- but I would need to know the endpoint used by Airbyte for the companies stream to mimic this exactly

Is there a way for me to see the specific attributes Airbyte is requesting for the endpoint /crm/v3/objects/company ?

<@U01MMSDJGC9> I just did a sync which created a bunch of new records in Hubspot (these were old accounts that weren’t created originally for some reason) yet these weren’t picked up in the latest Airbyte sync. How does Airbyte’s dedupe/incremental model work? Does it use a particular field from Hubspot to ensure incremental data? It seems bizarre that it is picking up records truly created today but not these old accounts that were still technically created today.

Records that were missing from the source data on Friday are now different that the records that are missing from the source data today after resetting the sync… Yet records are still missing. Now they are just different ones.

<@U02UFRZRJHX> sorry the missing reply here. This is not expected for a certified connector, do you mind filing a Github issue? I’ll share the issue with the connector team