Summary
Encountered an exception ‘NoneType’ object has no attribute ‘get’ while syncing leads data to Snowflake in Airbyte EC2 version 0.50.40
Question
Hi Folks,
We are working on Airbyte EC2 version, where we are trying to load leads data to Snowflake
However I am getting an exception in logs while running it and also it is not failing, its running
I am using Airbyte version: 0.50.40
If anyone has encountered similar issue please do let me know
Note: I was able to load campaigns data successfully
Thank you
2024-05-20 13:24:27 source > Encountered an exception while reading stream leads
Traceback (most recent call last):
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 136, in read
yield from self._read_stream(
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 237, in _read_stream
for record_data_or_message in record_iterator:
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/core.py", line 126, in read
slices = self.stream_slices(
File "/airbyte/integration_code/source_marketo/source.py", line 191, in stream_slices
param["fields"].extend(self.stream_fields)
File "/airbyte/integration_code/source_marketo/source.py", line 369, in stream_fields
available_fields = set(x.get("rest").get("name") for x in resp.json().get("result"))
File "/airbyte/integration_code/source_marketo/source.py", line 369, in <genexpr>
available_fields = set(x.get("rest").get("name") for x in resp.json().get("result"))
AttributeError: 'NoneType' object has no attribute 'get'
2024-05-20 13:24:27 source > Marking stream leads as STOPPED
2024-05-20 13:24:27 source > Finished syncing leads
2024-05-20 13:24:27 source > SourceMarketo runtimes:
Syncing stream campaigns 0:04:03.011830
Syncing stream leads 0:00:00.394491
2024-05-20 13:24:27 source > During the sync, the following streams did not sync successfully: leads: AirbyteTracedException("'NoneType' object has no attribute 'get'")
2024-05-20 13:24:27 source > None
Traceback (most recent call last):
File "/airbyte/integration_code/main.py", line 8, in <module>
run()
File "/airbyte/integration_code/source_marketo/run.py", line 14, in run
launch(source, sys.argv[1:])
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 235, in launch
for message in source_entrypoint.run(parsed_args):
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 122, in run
yield from map(AirbyteEntrypoint.airbyte_message_to_string, self.read(source_spec, config, config_catalog, state))
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 166, in read
for message in self.source.read(self.logger, config, catalog, state):
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/declarative/manifest_declarative_source.py", line 167, in read
yield from super().read(logger, config, catalog, state)
File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 185, in read
raise AirbyteTracedException(message=error_message, failure_type=FailureType.config_error)```
<br>
---
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1716211779997699) if you want
to access the original thread.
[Join the conversation on Slack](https://slack.airbyte.com)
<sub>
["airbyte-ec2", "leads-data", "snowflake", "exception", "syncing", "airbyte-version-0.50.40"]
</sub>