Source connector issue

Connector Questions & Issues
1
  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Ubuntu
  • Memory / Disk: 4Gb / 1 Tb
  • Deployment: Docker
  • Airbyte Version: 0.40.29
  • Source name/version: Facebook-Pages (latest)
  • Destination name/version: MSSQL (latest)
  • Step: Create a new connection with source and destination, no transformation and sync type set to manual. Then start sync
  • Description: When performing a sync, there is an internal error that is being throw. Attached is the log file.
    The data is saved on the db and when compared with the rows on the db vs the info from the connector the number matches.

0a97f1de_d2e0_454b_b13b_7635890444f4_logs_120_txt.txt (593.9 KB)

2

Hey @melroy-bsk, looks like the Facebook API ran into an internal server error:

Request to https://graph.facebook.com/v15.0/postid/posts?fields=id%2Cactions%2Cadmin_creator%2Capplication%2Cbackdated_time%2Ccall_to_action%2Ccan_reply_privately%2Cchild_attachments%2Ccoordinates%2Ccreated_time%2Cevent%2Cexpanded_height%2Cexpanded_width%2Cfeed_targeting%2Cfrom%2Cheight%2Cicon%2Cinstagram_eligibility%2Cis_eligible_for_promotion%2Cis_expired%2Cis_hidden%2Cis_inline_created%2Cis_instagram_eligible%2Cis_popular%2Cis_published%2Cis_spherical%2Cmessage%2Cmessage_tags%2Cmulti_share_end_card%2Cmulti_share_optimized%2Cparent_id%2Cpermalink_url%2Cplace%2Cprivacy%2Cpromotable_id%2Cpromotion_status%2Cproperties%2Cscheduled_publish_time%2Cshares%2Cstatus_type%2Cstory%2Cstory_tags%2Csubscribed%2Ctarget%2Ctargeting%2Ctimeline_visibility%2Cupdated_time%2Cvia%2Cvideo_buying_eligibility%2Cwidth%2Ccomments%2Cdynamic_posts%2Clikes%2Creactions%2Csharedposts%2Csponsor_tags%2Cto&after=QVFIUm5fbXpKQ0JJaExzYUZAmajRzY1JQTVFRSHQ4N1NNdUI0eUZAXRU9heEViS3BWckE0UG1MWGFmeHhCR0RteENScnk0VHhBMUk2dUlfQ05HaUtZAa3NkNlM1SXBHQ25xS3pJOExkdWFvdHQ0d0t0ZAEx3dkp6WW1BOHZAxSXNYbWs1dzNKeTJxbWFvYVJuQWh6b3hFWmtmT0dmaVMtWC1BMHBmSmN2YU5tcC1aZAUtBd3h5cEVxR1pFMWllQkpZAdWdKamo0Vm1LOWdVTVMyR0V1RTJkSzVDZAFUtcC1NUXFUNFlpdDV4U3lVc2JLUUI1N0M3R0wxWjNIUEhKa1p1NmlfNXAzd0daWmxqbERVclJqWnk5dEFvQjB3S3Vn&page_size=100&access_token=EAAJ8h1ICMGMBAJor4njU9eeuqokiuTl8qW6fGNDRfzNZBEKCkJbwNFIy3aRPZBall5UqYsfQUwmzes2TpdFDjfDAxyvjIixSbY0MSooroms5zfiOdpWg6U2xtqahgdn2dpBSKZAZAW97qJ6pUFXwwZBORSYQtLTn0ATiuaE5yXYyXxJJWDDcl failed with status code 500 and error message An unknown error has occurred.

And when I click on the link it says:

{
   "error": {
      "message": "(#10) This endpoint requires the 'pages_read_engagement' permission or the 'Page Public Content Access' feature. Refer to https://developers.facebook.com/docs/apps/review/login-permissions#manage-pages and https://developers.facebook.com/docs/apps/review/feature#reference-PAGES_ACCESS for details.",
      "type": "OAuthException",
      "code": 10,
      "fbtrace_id": "AKzreenQBUsyJz8JtUKiFzh"
   }
}

So looks like you need to request those permissions for your API account!

3

I did add those permissions, before creating the token. Shouldn’t the sync throw an error when it is fetching the first 100 rows, if the permissions are not available ?

4

That’s a really good point, I’m not quite sure and need to look into that! I’ve seen this issue come up with Facebook APIs before and it hasn’t been super clear why. Let me look into it and I’ll get back to you soon!

5

Hey @natalyjazzviolin did you figure out what the issue was?