csv import slow

[Sergey Pashkov]

Hi Jon,

1) How many columns are there in this file?
2) Do you create a new table yourself with all needed fields,
or you select an option to create it automatically?

My test file (9.5 Mb, 11 fields, 30,000 records) was imported into prepared
table during a few seconds,
here's a video of the process:
https://www.dropbox.com/s/1vel4mroshjuzam/csv_import.mp4?dl=0

--
Best regards,
Sergey Pashkov

On Fri, Oct 10, 2014 at 5:49 PM, Ruslan Zasukhin <
ruslan_zasukhin at valentina-db.com> wrote:

> On 10/10/14, 3:40 PM, "Jonathan Evans" <consultjonevans at gmail.com> wrote:
>
> Hi Jonathan,
>
> It seems its Vstudio itslf problem.
> Valentina DB via API command can do this of course fast.
>
>
> Just month ago was fix for SQLite in this area.
>
> Sergey, may be was inserted flush() into loop?
> Please check let me know in chat ...
>
>
> > Yes that's right.
> >
> > On Fri, Oct 10, 2014 at 6:37 AM, Sergey Pashkov
> > <sergey_pashkov at valentina-db.com> wrote:
> > Hi Jon,
> > So you have tried to import CSV file into a new table in a local
> Valentina
> > Database and it was very slow?
> >
> > --
> > Best regards,
> > Sergey Pashkov.
> >
> > On Fri, Oct 10, 2014 at 3:19 PM, Jonathan Evans <
> consultjonevans at gmail.com>
> > wrote:
> > Hi there
> > Have just used Valentina Studio's import from csv wizard to import a 9MB
> csv
> > file with 30,000 rows into a new table. It took about one hour.
> > This seems slow to me. Opening the same csv in Excel takes seconds.
> Importing
> > into MySQL is quick also.
> > 1) What are your experiences of importing medium-large csv files into
> > Valentina?
> > 2) Any tips for speeding up the process?
> > 3) My aspiration is to import much larger csv files with 1 million +
> rows. How
> > realistic is that?
> > Thanks for your help.
>
> --
> Best regards,
>
> Ruslan Zasukhin
> VP Engineering and New Technology
> Paradigma Software, Inc
>
> Valentina - Joining Worlds of Information
> http://www.paradigmasoft.com
>
> [I feel the need: the need for speed]
>
>
> _______________________________________________
> Valentina-studio mailing list
> Valentina-studio at lists.macserve.net
> http://lists.macserve.net/mailman/listinfo/valentina-studio
>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.macserve.net/pipermail/valentina-studio/attachments/20141010/c6271a58/attachment.html>