speed of importing

[Ruslan Zasukhin]

On 1/4/05 2:41 PM, "jda" <jda at his.com> wrote:

>> IMPORTANT:
>> 
>> * if you change MANY records, you may consider remove index.
>>    
>>     not-indexed field give linear time for adding.
>> 
>> Btw, I have see that import of 50 records with PUB format,
>> You make with indexes ON.
>> 
>> Remove indexes, and I think import of 4000 records will be done not in 12
>> minutes but in few seconds.
>> 
> 
> Actually, I tried that. Importing was only *slightly* faster for the
> first several thousand records (it did maintain speed better when it
> got to 10000 records, though)! And in V1.x (to which I compare V2),
> importing was much faster with indexing ON.

No, this can't be.

What size of data you import?
What size of cache ?
What size of final db ?


> The problem with turning indexing OFF is that my app doesn't know how
> may records are going to be imported beforehand. Therefore, if  only
> one is being imported (quite common), when a large db (say 30000
> records) is *reindexed* after importing that one record it is going
> to take a long time. And having the user decide whether to have
> indexing on or off during a particular import is too techie for a
> consumer app. So I leave it ON all the time, which as I said, worked
> well for V1.

Number of records to import you can estimate by the size of file.


-- 
Best regards,
Ruslan Zasukhin      [ I feel the need...the need for speed ]
-------------------------------------------------------------
e-mail: ruslan at paradigmasoft.com
web: http://www.paradigmasoft.com

To subscribe to the Valentina mail list go to:
http://lists.macserve.net/mailman/listinfo/valentina
-------------------------------------------------------------