odd indexed string behaviour?
Mr. Bart Pietercil
bart.pietercil at cognosis.be
Tue Aug 28 08:20:45 CDT 2012
Hi ,
we solved the indexing problem by MD5 the string. This effectively solved the 256 symbols problem.
Just an idea…
regards
Bart
On 28 Aug 2012, at 15:09, George Parkinson wrote:
> hi ruslan,
> the problem is two-fold...storage and indexing
>
> 1 - storage: for this project, i ship out read-only survey results.
> clients never start with an empty db...they consume what is shipped.
> i'm going to have major push back from clients (000's) when i replace what i ship now with something approaching twice the size.
>
> 2 - indexing: the first 256 symbols of each record is indeed 256 when using utf8, but becomes 128 when using utf16.
> i have a field of 188 characters (ascii 34-127) that is essentially the index...but with utf16 indexing won't work.
>
> splitting into two fields, with each indexed won't work because the 128 symbol limit is for the record.
> dropping the index is not an option because of the volume of data (hundreds of thousands of records a month with an average retention of 4 yrs).
>
> this is why i'm looking for utf8 in valentina.
>
> thanks,
> george
>
>
> From: Ruslan Zasukhin <ruslan_zasukhin at valentina-db.com>
> To: "valentina at lists.macserve.net" <valentina at lists.macserve.net>
> Sent: Tuesday, August 28, 2012 2:33:09 AM
> Subject: Re: odd indexed string behaviour?
>
> On 8/28/12 4:52 AM, "George Parkinson" <george at microtherapy.ca> wrote:
>
> Hi George,
>
> > ok "utf16 for now".
> >
> > i really want to use valentina for a major project but the lack of utf8 is a
> > roadblock.
>
> Why?
>
> Do you going to use TEXT Fields?
> If yes, you can use ZIP compression still having indexing.
>
> I hard see that today size of db can matter ...
> HDDs are so cheap .
>
>
> > will it become reality? and if so, can you estimate when?
>
> Yes why not,
>
> When we seat and fix that utf8 related issues.
>
> --
> Best regards,
>
> Ruslan Zasukhin
> VP Engineering and New Technology
> Paradigma Software, Inc
>
> Valentina - Joining Worlds of Information
> http://www.paradigmasoft.com
>
> [I feel the need: the need for speed]
>
>
> _______________________________________________
> Valentina mailing list
> Valentina at lists.macserve.net
> http://lists.macserve.net/mailman/listinfo/valentina
>
>
> _______________________________________________
> Valentina mailing list
> Valentina at lists.macserve.net
> http://lists.macserve.net/mailman/listinfo/valentina
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.macserve.net/pipermail/valentina/attachments/20120828/a8b5e530/attachment-0001.html>
More information about the Valentina
mailing list