Summary
The user is facing an error ‘java.lang.IllegalArgumentException: Only top-level primary keys are supported’ when trying to create a connector between DynamoDB source and BigQuery destination due to DynamoDB using Composite keys and BigQuery only supporting top-level primary keys. The user is looking for a way to achieve this connection.
Question
Hello
I’m trying to create a connector between DynamoDb source to BigQuery destination but I have this error:
java.lang.IllegalArgumentException: Only top-level primary keys are supported
I’m thinking about a problem from Dynamodb using Composite leys (primary + sort) and Bigquery than can only support primary keys.
Is there a way to achieve this kind of connection?
This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want to access the original thread.