Source Shopify - connectors having problems

Connector Questions & Issues
,
1
  • Is this your first time deploying Airbyte?: No
  • OS Version / Instance: Ubuntu running on GCP Compute Instance
  • Memory / Disk: Mem - 16GB / Storage - 100GB
  • Deployment: Docker deployment
  • Airbyte Version: 0.39.39 Alpha
  • Source name/version: Shopify - 0.1.37
  • Destination name/version: BigQuery - 1.1.11
  • Step: The issue is happening during the retrieval of data from the source, (I presume)
  • Description: Checked all the API endpoints from Shopify account and found some of the tables are having problem (error of table not found). Removed them. However, still having the same problem of “source cannot be stopped” during the retrieval of data from Shopify. Could not figure out the problem with this. Here are the logs. I have scheduled multiple store however only this one has this problem here.
    logs-1158.txt (2.9 MB)

Do let me know if you need any more information with regards to this.
Seng.

1 Like
2

Hello there! You are receiving this message because none of your fellow community members has stepped in to respond to your topic post. (If you are a community member and you are reading this response, feel free to jump in if you have the answer!) As a result, the Community Assistance Team has been made aware of this topic and will be investigating and responding as quickly as possible.
Some important considerations that will help your to get your issue solved faster:

  • It is best to use our topic creation template; if you haven’t yet, we recommend posting a followup with the requested information. With that information the team will be able to more quickly search for similar issues with connectors and the platform and troubleshoot more quickly your specific question or problem.
  • Make sure to upload the complete log file; a common investigation roadblock is that sometimes the error for the issue happens well before the problem is surfaced to the user, and so having the tail of the log is less useful than having the whole log to scan through.
  • Be as descriptive and specific as possible; when investigating it is extremely valuable to know what steps were taken to encounter the issue, what version of connector / platform / Java / Python / docker / k8s was used, etc. The more context supplied, the quicker the investigation can start on your topic and the faster we can drive towards an answer.
  • We in the Community Assistance Team are glad you’ve made yourself part of our community, and we’ll do our best to answer your questions and resolve the problems as quickly as possible. Expect to hear from a specific team member as soon as possible.

Thank you for your time and attention.
Best,
The Community Assistance Team

3

Can you check your firewall settings? The traceback logs shows:

Traceback (most recent call last): File "/airbyte/integration_code/main.py", line 13, in <module> launch(source, sys.argv[1:]) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 127, in launch for message in source_entrypoint.run(parsed_args): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/entrypoint.py", line 118, in run for message in generator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 123, in read raise e File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 114, in read yield from self._read_stream( File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 159, in _read_stream for record in record_iterator: File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/abstract_source.py", line 215, in _read_incremental for record_counter, record_data in enumerate(records, start=1): File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 373, in read_records response = self._send_request(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 337, in _send_request return backoff_handler(user_backoff_handler)(request, request_kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 110, in retry ret = target(*args, **kwargs) File "/usr/local/lib/python3.9/site-packages/backoff/_sync.py", line 110, in retry ret = target(*args,**kwargs) File "/usr/local/lib/python3.9/site-packages/airbyte_cdk/sources/streams/http/http.py", line 288, in _send response: requests.Response = self._session.send(request, **request_kwargs) File "/usr/local/lib/python3.9/site-packages/requests/sessions.py", line 687, in send r.content File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 838, in content self._content = b''.join(self.iter_content(CONTENT_CHUNK_SIZE)) or b'' File "/usr/local/lib/python3.9/site-packages/requests/models.py", line 763, in generate raise ChunkedEncodingError(e)requests.exceptions.ChunkedEncodingError: ("	, ConnectionResetError(104, 'Connection reset by peer'))

Which is caused (mostly) for Firewall configuration.