Error when creating connector between DynamoDB and BigQuery

Summary

The user is facing an error ‘java.lang.IllegalArgumentException: Only top-level primary keys are supported’ when trying to create a connector between DynamoDB source and BigQuery destination due to DynamoDB using Composite keys and BigQuery only supporting top-level primary keys. The user is looking for a way to achieve this connection.


Question

Hello :wave:
I’m trying to create a connector between DynamoDb source to BigQuery destination but I have this error:
java.lang.IllegalArgumentException: Only top-level primary keys are supported
I’m thinking about a problem from Dynamodb using Composite leys (primary + sort) and Bigquery than can only support primary keys.
Is there a way to achieve this kind of connection?



This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.

Join the conversation on Slack

["error", "connector", "dynamodb", "bigquery", "composite-keys", "primary-keys"]

https://github.com/airbytehq/airbyte/issues/30250