Issue with GitHub Source Logs

Summary

Users are facing issues with the GitHub source connector logs, specifically encountering conflicts and empty Git repositories. The logs show system errors, config errors, and non-zero exit codes.


Question

Hi! Does anyone else has this problem with github source? I’m trying to look at the logs but It is not clear enough.

  "failureOrigin" : "source",
  "failureType" : "system_error",
  "internalMessage" : "Conflict.",
  "externalMessage" : "Git Repository is empty.",
  "metadata" : {
    "attemptNumber" : 1,
    "jobId" : 429,
    "from_trace_message" : true,
    "connector_command" : "read"
  },
  "stacktrace" : "Traceback (most recent call last):\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/abstract_source.py\", line 133, in read\n    yield from self._read_stream(\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/abstract_source.py\", line 239, in _read_stream\n    for record_data_or_message in record_iterator:\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/streams/core.py\", line 192, in read\n    for record_data_or_message in records:\n  File \"/airbyte/integration_code/source_github/streams.py\", line 307, in read_records\n    for record in super().read_records(\n  File \"/airbyte/integration_code/source_github/streams.py\", line 130, in read_records\n    yield from super().read_records(stream_slice=stream_slice, **kwargs)\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 335, in read_records\n    yield from self._read_pages(\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 387, in _read_pages\n    request, response = self._fetch_next_page(stream_slice, stream_state, next_page_token)\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/streams/http/http.py\", line 452, in _fetch_next_page\n    request, response = self._http_client.send_request(\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/streams/http/http_client.py\", line 382, in send_request\n    response: requests.Response = self._send_with_retry(\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/streams/http/http_client.py\", line 228, in _send_with_retry\n    response = backoff_handler(rate_limit_backoff_handler(user_backoff_handler))(request, request_kwargs, log_formatter=log_formatter, exit_on_rate_limit=exit_on_rate_limit)  # type: ignore # mypy can't infer that backoff_handler wraps _send\n  File \"/usr/local/lib/python3.10/site-packages/backoff/_sync.py\", line 105, in retry\n    ret = target(*args, **kwargs)\n  File \"/usr/local/lib/python3.10/site-packages/backoff/_sync.py\", line 105, in retry\n    ret = target(*args, **kwargs)\n  File \"/usr/local/lib/python3.10/site-packages/backoff/_sync.py\", line 105, in retry\n    ret = target(*args, **kwargs)\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/streams/http/http_client.py\", line 334, in _send\n    raise UserDefinedBackoffException(\nairbyte_cdk.sources.streams.http.exceptions.UserDefinedBackoffException: Conflict.\n",
  "timestamp" : 1725980299262,
  "streamDescriptor" : {
    "name" : "commits"
  }
}, {
  "failureOrigin" : "source",
  "failureType" : "config_error",
  "externalMessage" : "During the sync, the following streams did not sync successfully: commits: AirbyteTracedException('Conflict.')",
  "metadata" : {
    "attemptNumber" : 1,
    "jobId" : 429,
    "from_trace_message" : true,
    "connector_command" : "read"
  },
  "stacktrace" : "Traceback (most recent call last):\n  File \"/airbyte/integration_code/main.py\", line 8, in <module>\n    run()\n  File \"/airbyte/integration_code/source_github/run.py\", line 17, in run\n    launch(source, sys.argv[1:])\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/entrypoint.py\", line 234, in launch\n    for message in source_entrypoint.run(parsed_args):\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/entrypoint.py\", line 122, in run\n    yield from map(AirbyteEntrypoint.airbyte_message_to_string, self.read(source_spec, config, config_catalog, state))\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/entrypoint.py\", line 164, in read\n    for message in self.source.read(self.logger, config, catalog, state):\n  File \"/usr/local/lib/python3.10/site-packages/airbyte_cdk/sources/abstract_source.py\", line 177, in read\n    raise AirbyteTracedException(message=error_message, failure_type=FailureType.config_error)\nairbyte_cdk.utils.traced_exception.AirbyteTracedException: None\n",
  "timestamp" : 1725980299265
}, {
  "failureOrigin" : "source",
  "internalMessage" : "Source process exited with non-zero exit code 1",
  "externalMessage" : "Something went wrong within the source connector",
  "metadata" : {
    "attemptNumber" : 1,
    "jobId" : 429,
    "connector_command" : "read"
  },
  "stacktrace" : "io.airbyte.workers.internal.exception.SourceException: Source process exited with non-zero exit code 1\n\tat io.airbyte.workers.general.BufferedReplicationWorker.readFromSource(BufferedReplicationWorker.java:378)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithHeartbeatCheck$3(BufferedReplicationWorker.java:242)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1583)\n",
  "timestamp" : 1725980300572
} ]```

<br>

---

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. [Click here](https://airbytehq.slack.com/archives/C021JANJ6TY/p1725980916995279) if you want 
to access the original thread.

[Join the conversation on Slack](https://slack.airbyte.com)

<sub>
["github-source", "logs", "conflict", "empty-git-repository", "system-error", "config-error", "non-zero-exit-code"]
</sub>