Issue Parsing API Response for Custom Connector

Slack Knowledge Base Q&A Connector Development
, , , ,
1

Summary

User is facing issues with parsing an API response while building a custom connector using the no-code tool, specifically with the structure of the JSON received.


Question

Hey guys, I am trying to build a custom connector using the no-code tool. I am not being able to parse the response successfully. The API response (inside the body of the response) looks like this:

    "columns": [
        "date",
        "column1",
        "column2",
        "column3",
        "column4",
        "column5"
    ],
    "rows": [
        [
            "2024-11-28",
            0.0,
            0.0,
            55555,
            6666,
            7777
        ],
        [
            "2024-11-29",
            0.0,
            0.0,
            1111,
            22222,
            33333
        ],
        [
            "2024-11-30",
            0.0,
            0.0,
            9999,
            4444,
            8888
        ]
    ],
    "displayValue": {
        "date": {
            "2024-11-30": "2024-11-30",
            "2024-11-29": "2024-11-29",
            "2024-11-28": "2024-11-28"
        }
    },
    "currency": "USD",
    "currencySymbol": "$",
    "alert": null
}```

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C027KKE4BCZ/p1733174273200609) if you want
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
['custom-connector', 'api-response', 'no-code-tool', 'json-parsing']
</sub>
2

I don’t think it’s possible with record selector
https://docs.airbyte.com/connector-development/config-based/understanding-the-yaml-file/record-selector
https://github.com/airbytehq/airbyte-python-cdk/blob/19afe5a1400e38e8cae0627a6be8a3bd4d254e4a/airbyte_cdk/sources/declarative/extractors/record_selector.py#L90-L100|record_selector.py#L90-L100

Couple options here
• storing whole response without parsing
• Low-Code CDK with custom components https://docs.airbyte.com/connector-development/config-based/advanced-topics#custom-components
• Python CDK (or Java)

3

Thanks <@U05JENRCF7C>!