odd indexed string behaviour?

[George Parkinson]

hi ruslan,
the problem is two-fold...storage and indexing

1 - storage: for this project,  i ship out read-only survey results.   
clients never start with an empty db...they consume what is shipped.
i'm going to have major push back from clients (000's) when i replace what i ship now with something approaching twice the size.  

2 - indexing: the first 256 symbols of each record is indeed 256 when using utf8, but becomes 128 when using utf16.
i have a field of 188 characters (ascii 34-127) that is essentially the index...but with utf16 indexing won't work.

splitting into two fields, with each indexed won't work because the 128 symbol limit is for the record.
dropping the index is not an option because of the volume of data (hundreds of thousands of records a month with an average retention of 4 yrs). 


this is why i'm looking for utf8 in valentina.


thanks,
george



________________________________
 From: Ruslan Zasukhin <ruslan_zasukhin at valentina-db.com>
To: "valentina at lists.macserve.net" <valentina at lists.macserve.net> 
Sent: Tuesday, August 28, 2012 2:33:09 AM
Subject: Re: odd indexed string behaviour?
 
On 8/28/12 4:52 AM, "George Parkinson" <george at microtherapy.ca> wrote:

Hi George,

> ok "utf16 for now".
> 
> i really want to use valentina for a major project but the lack of utf8 is a
> roadblock. 

Why? 

Do you going to use TEXT Fields?
If yes, you can use ZIP compression still having indexing.

I hard see that today size of db can matter  ...
HDDs are so cheap .


> will it become reality?  and if so, can you estimate when?

Yes why not, 

When we seat and fix that utf8 related issues.

-- 
Best regards,

Ruslan Zasukhin
VP Engineering and New Technology
Paradigma Software, Inc

Valentina - Joining Worlds of Information
http://www.paradigmasoft.com

[I feel the need: the need for speed]


_______________________________________________
Valentina mailing list
Valentina at lists.macserve.net
http://lists.macserve.net/mailman/listinfo/valentina
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.macserve.net/pipermail/valentina/attachments/20120828/f4c20f64/attachment.html>