Changing character sets in text fields

Robert Brenstein rjb at rz.uni-potsdam.de
Fri Aug 13 12:28:52 CDT 2004


Ben, you hit something I have been complaining about for a few years 
now. Valentina senses that the field content was entered on Mac and 
automatically converts its encoding when it is accessed on Windows. 
In my web application, I just keep converting back and forth 
(undoubtedly wasting precious cpu cycles) ensuring that the data 
stored in db matches the platform the db runs on.

>I built a Valentina database on the Mac, which included text fields into
>which I carefully put text constructed in ISO-8859-1, because that was how
>the application that would be using the database on Windows would be
>treating it.
>
>However, the data came out wrong on Windows - it looked just like I'd expect
>ISO-8859-1 to look like on the Mac.  I then rebuilt the database (again on
>the Mac) with text in the MacRoman character set, and it came out 'right' on
>Windows.
>
>Obviously Valentina had done some conversion on the data.  It's very kind of
>Valentina, but it was unexpected, and it may not be what I want.

Yes, Ruslan tried to make it too friendly :)

>I've not been able to find any reference to this behaviour in the
>documentation.  I'd like to know:

Search the list archives. This was discussed a number of times.

>* how and where this happens.  EG, is the data stored internally in unicode,
>and transformed on both storage and retrieval according to the local
>platform?  Or is it always stored in one character set, and Valentina
>transforms on storage and retrieval on some platforms?  Or is it always
>stored exactly as inserted, with a flag to cause transformation on retrieval
>in some situations?  Or some other arrangement?

In Valentina 1.x, data is stored as ascii text. Unicode storage comes 
in 2. Valentina converts on retrieval as far as I know.

>* under what circumstances this is applied.  EG is it any 'text' field?
>what about 'varchar'?

any field that contains character data (string, varchar, text)

>* can this be configured.  Is there a setting either in Valentina, or per
>database or per table, that can be used to avoid this behaviour when it is
>not desired?

Nop. I truly hope this will change in version 2.

Robert Brenstein


More information about the Valentina mailing list