Re: [fpc-pascal] Firebird: bulk insert performance: suggestions?

2012-09-07 Thread Martin Schreiber
On Saturday 08 September 2012 01:05:28 Graeme Geldenhuys wrote: > On 07/09/12 12:12, michael.vancann...@wisa.be wrote: > > I once did tests with that (600.000 records) and did not notice any > > influence of the transaction control. > > Same here... I've imported 100's of thousands of records with

Re: [fpc-pascal] Firebird: bulk insert performance: suggestions?

2012-09-07 Thread Graeme Geldenhuys
On 07/09/12 12:12, michael.vancann...@wisa.be wrote: I once did tests with that (600.000 records) and did not notice any influence of the transaction control. Same here... I've imported 100's of thousands of records with SqlDB+Firebird with no serious speed issues. Also from CSV files. Trans

Re: [fpc-pascal] Re: Firebird: bulk insert performance: suggestions?

2012-09-07 Thread Ludo Brands
> If it prepares the statement automatically, it also > unprepares it. (at least, it should :) ) > I does for every change in query, connection, transaction, active state of dataset, filter, etc. , but not at the end of an execsql. Ludo ___ fpc-pascal

Re: [fpc-pascal] Re: Firebird: bulk insert performance: suggestions?

2012-09-07 Thread Ludo Brands
> > Do you prepare the query before you start the batch ? > > If not, it is prepared on every insert, which is inherently slower. > I didn't do an explicit .Prepare, but I've added it, thanks. > I thought sqldb would prepare automatically if you are using > parameters though? sqldb always uses a

[fpc-pascal] Re: Firebird: bulk insert performance: suggestions?

2012-09-07 Thread Reinier Olislagers
On 7-9-2012 13:22, Ludo Brands wrote: >> For my Dutch postcode program https://bitbucket.org/reiniero/postcode >> with an embedded Firebird 2.5 database, I allow users to read >> in a CSV file with new or updated postcode data. I use sqldb, >> FPC x86. I'd like to get your suggestions on speed im

Re: [fpc-pascal] Re: Firebird: bulk insert performance: suggestions?

2012-09-07 Thread michael . vancanneyt
On Fri, 7 Sep 2012, Reinier Olislagers wrote: On 7-9-2012 13:12, michael.vancanneyt-0is9kj9s...@public.gmane.org wrote: On Fri, 7 Sep 2012, Reinier Olislagers wrote: then the transaction is started (if it is inactive) and the query parameters are filled (using Query.Params.ParamByName, but I

Re: [fpc-pascal] Firebird: bulk insert performance: suggestions?

2012-09-07 Thread Ludo Brands
> For my Dutch postcode program https://bitbucket.org/reiniero/postcode > with an embedded Firebird 2.5 database, I allow users to read > in a CSV file with new or updated postcode data. I use sqldb, > FPC x86. I'd like to get your suggestions on speed improvements. > Turn of indices when inser

[fpc-pascal] Re: Firebird: bulk insert performance: suggestions?

2012-09-07 Thread Reinier Olislagers
On 7-9-2012 13:12, michael.vancanneyt-0is9kj9s...@public.gmane.org wrote: > On Fri, 7 Sep 2012, Reinier Olislagers wrote: >> then the transaction is started (if it is inactive) and the query >> parameters are filled (using Query.Params.ParamByName, but I don't >> suppose that would be a big slowdow

Re: [fpc-pascal] Firebird: bulk insert performance: suggestions?

2012-09-07 Thread michael . vancanneyt
On Fri, 7 Sep 2012, Reinier Olislagers wrote: For my Dutch postcode program https://bitbucket.org/reiniero/postcode with an embedded Firebird 2.5 database, I allow users to read in a CSV file with new or updated postcode data. I use sqldb, FPC x86. I'd like to get your suggestions on speed imp

[fpc-pascal] Firebird: bulk insert performance: suggestions?

2012-09-07 Thread Reinier Olislagers
For my Dutch postcode program https://bitbucket.org/reiniero/postcode with an embedded Firebird 2.5 database, I allow users to read in a CSV file with new or updated postcode data. I use sqldb, FPC x86. I'd like to get your suggestions on speed improvements. I try to get the data into a temporary