csv import slow

[Ruslan Zasukhin]

On 10/10/14, 3:40 PM, "Jonathan Evans" <consultjonevans at gmail.com> wrote:

Hi Jonathan,

It seems its Vstudio itslf problem.
Valentina DB via API command can do this of course fast.


Just month ago was fix for SQLite in this area.

Sergey, may be was inserted flush() into loop?
Please check let me know in chat ...


> Yes that's right.
> 
> On Fri, Oct 10, 2014 at 6:37 AM, Sergey Pashkov
> <sergey_pashkov at valentina-db.com> wrote:
> Hi Jon,
> So you have tried to import CSV file into a new table in a local Valentina
> Database and it was very slow?
> 
> --
> Best regards,
> Sergey Pashkov.
> 
> On Fri, Oct 10, 2014 at 3:19 PM, Jonathan Evans <consultjonevans at gmail.com>
> wrote:
> Hi there
> Have just used Valentina Studio's import from csv wizard to import a 9MB csv
> file with 30,000 rows into a new table. It took about one hour.
> This seems slow to me. Opening the same csv in Excel takes seconds. Importing
> into MySQL is quick also.
> 1) What are your experiences of importing medium-large csv files into
> Valentina?
> 2) Any tips for speeding up the process?
> 3) My aspiration is to import much larger csv files with 1 million + rows. How
> realistic is that?
> Thanks for your help.

-- 
Best regards,

Ruslan Zasukhin
VP Engineering and New Technology
Paradigma Software, Inc

Valentina - Joining Worlds of Information
http://www.paradigmasoft.com

[I feel the need: the need for speed]