Custom Insights streams issue with Facebook Marketing connector

Summary

User seeks advice on customizing Facebook Marketing source connector in Airbyte to calculate cumulative Reach by Ad over multiple days, in contrast to default Ads_Insights stream limitations.


Question

Has anyone been able to overcome the issues with Custom Insights streams using the Facebook Marketing source connector? Is there a setting I can use in Airbyte Cloud that will allow me to get the right data? I’d really prefer to keep exclusively use Airbyte for pulling all my Facebook Ads result data, but I need to calculate Reach by Ad as a cumulative total “through” each day, instead of only the reach that the ad delivered on a single day, which is what the default Ads_Insights stream provides.

Anyone have any advice or suggestions for how I can accomplish this?

Thanks!

#facebook_marketing #custom_insights



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

['facebook-marketing', 'custom-insights', 'ads-insights', 'airbyte-cloud']

Could you refer to a GitHub issue that provides more information about the problem? I couldn’t find any previous discussion on what you’re describing.

The GitHub issue was only partially related. This is the one I saw when I searched for others experiencing trouble with the custom insights streams using FB Marketing source with Airbyte. https://github.com/airbytehq/airbyte/issues/38088

It talks about ad_id showing up with null values. Through some trouble-shooting of my own, it looks like you have to include ALL the fields you want output in the “fields” prompt, even if it’s already selected in the level prompt (i.e. ad, ad_set or campaign).

But <@U01MMSDJGC9> - I’m really eager to figure out how to solve for my main issue, which is that I need to download cumulative (life through end date) reach by ad_id and day, as well as ad_set and day, and campaign and day. Because Facebook calculates reach as a distinct count of users over time, if these are calculated only within a single day, the count of reach will be overlapping with the same users across multiple days, meaning I cannot just sum the reach over time. I have to make a separate API call to FB Mktg every day, iteratively, for each ad_id, ad_set, and campaign. This will allow me to blend in the cume_reach at the ad, ad_set and campaign level with my other ad insights data so that it more closely matches the results when viewed in platform.

Any ideas? on ways to use Airbyte for this?

Maybe someone in the community has built a custom connector for custom FB Mktg API calls that I could also use?