Error with AWS Datalake Destination and PyArrow Schema Precision


The user is facing an error with the AWS Datalake Destination connector related to schema precision in PyArrow. They are looking for guidance on how to adjust the schema to resolve the issue.


I have problem with Destination AWS Datalake 0.1.10 - error is ('Decimal type with precision 16 does not fit into precision inferred from first array element: 38', 'Conversion failed for column amount with type object')

It is problem with PyArrow schema maybe, how I can fix schema with necessary precision?

This topic has been created from a Slack thread to give it more visibility.
It will be on Read-Only mode here. Click here if you want
to access the original thread.

Join the conversation on Slack

["aws-datalake-connector", "pyarrow-schema", "precision", "error"]