Importing text data containing accented characters

Classic Servoy
1

I have to import data from csv files containing names with accented characters (french and italian). The text files are BBEdit documents whose character encoding is UTF-8, converted from csv files generated by Excel. I have created an AppleScript that takes care of all this. The backend DB is MySql 5.0.67 with InnoDB tables and UTF-8 encoding. Servoy 4.0/Eclipse is set to use UTF-8 encoding wherever possible. However all the accented characters are misinterpreted in the import phase and substituted with others. The capital E with a grave accent (È) becomes √à, the lowercase a with a grave accent (à) is transformed in ?†.

I have written a function that takes care of this, and after the import is finished restores the correct values. But is there a way to avoid all this and import accented characters without substitution?

2

Hi Rioba,

How do you import the csv file ? Using Servoy’s built in import functionality or via a custom method?
If you use a custom method then note that you can set the charset when you read the csv file:

var textData = plugins.file.readTXTFile( fileObject, 'UTF-8')

Hope this helps.

3

Thank you Robert,

I get the same result using the built-in import and a custom method. However, I did not specify the charset in the custom method. I will try that and see what happens