odd indexed string behaviour?

[Mr. Bart Pietercil]

Hi ,

we solved the indexing problem by MD5 the string. This effectively solved the 256 symbols problem.
Just an idea…

regards

Bart


On 28 Aug 2012, at 15:09, George Parkinson wrote:

> hi ruslan,
> the problem is two-fold...storage and indexing
> 
> 1 - storage: for this project,  i ship out read-only survey results.   
> clients never start with an empty db...they consume what is shipped.
> i'm going to have major push back from clients (000's) when i replace what i ship now with something approaching twice the size.  
> 
> 2 - indexing: the first 256 symbols of each record is indeed 256 when using utf8, but becomes 128 when using utf16.
> i have a field of 188 characters (ascii 34-127) that is essentially the index...but with utf16 indexing won't work.
> 
> splitting into two fields, with each indexed won't work because the 128 symbol limit is for the record.
> dropping the index is not an option because of the volume of data (hundreds of thousands of records a month with an average retention of 4 yrs). 
> 
> this is why i'm looking for utf8 in valentina.
> 
> thanks,
> george
> 
> 
> From: Ruslan Zasukhin <ruslan_zasukhin at valentina-db.com>
> To: "valentina at lists.macserve.net" <valentina at lists.macserve.net> 
> Sent: Tuesday, August 28, 2012 2:33:09 AM
> Subject: Re: odd indexed string behaviour?
> 
> On 8/28/12 4:52 AM, "George Parkinson" <george at microtherapy.ca> wrote:
> 
> Hi George,
> 
> > ok "utf16 for now".
> > 
> > i really want to use valentina for a major project but the lack of utf8 is a
> > roadblock. 
> 
> Why? 
> 
> Do you going to use TEXT Fields?
> If yes, you can use ZIP compression still having indexing.
> 
> I hard see that today size of db can matter  ...
> HDDs are so cheap .
> 
> 
> > will it become reality?  and if so, can you estimate when?
> 
> Yes why not, 
> 
> When we seat and fix that utf8 related issues.
> 
> -- 
> Best regards,
> 
> Ruslan Zasukhin
> VP Engineering and New Technology
> Paradigma Software, Inc
> 
> Valentina - Joining Worlds of Information
> http://www.paradigmasoft.com
> 
> [I feel the need: the need for speed]
> 
> 
> _______________________________________________
> Valentina mailing list
> Valentina at lists.macserve.net
> http://lists.macserve.net/mailman/listinfo/valentina
> 
> 
> _______________________________________________
> Valentina mailing list
> Valentina at lists.macserve.net
> http://lists.macserve.net/mailman/listinfo/valentina

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.macserve.net/pipermail/valentina/attachments/20120828/a8b5e530/attachment-0001.html>