When using this source: https://opendata.dwd.de/climate_environment/CDC/regional_averages_DE/annual/sunshine_duration/regional_averages_sd_year.txt
I set these reader options: {"sep" : ";", "skiprows" : 1, "skipinitialspace": true, "engine": "python"}
then the result is an empty dataset. Even the originally raw table is empty:
ha, now it succeeded in getting data to the table with these reader options: {"sep" : ";", "skiprows" : 1, "skipinitialspace": true, "usecols": [0,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17]}
But now it’s not possible to get more than the first time sync working. Any subsequent sync attempt fails. Log is attached. Sync mode is set to ‘Full refresh | Overwrite’.
Hello, that would be great if there is a workaround - how to get it to work with the workaround?
As described, I set it to ‘Full refresh | Overwrite’, but this leads to failure after initial sync.
Indeed, that is what I want in this case - the table should be completely overwritten.
By the way, it also fails when selecting to ‘Reset your data’.
Oh I thought the full refresh worked.
There are two ways to follow here: disable normalization OR run the first time, export normalization and edit to start working with MSSQL.
I deleted and re-created the database, but this time with all letters in lower case for database name, and schema name.
And voilà: now it’s also working the second and more time to run a sync (Full refresh|Overwrite)
So the issue seems to be that normalization to lowercase letters is handled differently at some stages during all those process steps, and using lower case letters from the start seems to circumvent the possible problems that arise because of that…
