Re: [GENERAL] general questions postgresql performance config

2010-01-26 Thread Jayadevan M
Hi, Regarding Pentaho - please keep in mind that Pentaho needs significant amount of memory. We had a lot of issues with Pentaho crashing with java out of memory error. If you are using a 64 bit machine, you may be able to give it sufficient RAM and keep it happy. If all you have is one 4 GB ma

Re: [GENERAL] general questions postgresql performance config

2010-01-26 Thread Greg Smith
Andy Colson wrote: I recall seeing someplace that you can avoid WAL if you start a transaction, then truncate the table, then start a COPY. Is that correct? Still hold true? Would it make a lot of difference? That is correct, still true, and can make a moderate amount of difference if the

Re: [GENERAL] general questions postgresql performance config

2010-01-26 Thread Andy Colson
On 1/25/2010 8:12 PM, Craig Ringer wrote: On 26/01/2010 12:15 AM, Dino Vliet wrote: 5) Other considerations? Even better is to use COPY to load large chunks of data. libpq provides access to the COPY interface if you feel like some C coding. The JDBC driver (dev version only so far) now prov

Re: [GENERAL] general questions postgresql performance config

2010-01-25 Thread Scott Marlowe
On Mon, Jan 25, 2010 at 9:15 AM, Dino Vliet wrote: > > Introduction > Today I've been given the task to proceed with my plan to use postgresql and > other open source techniques to demonstrate to the management of my > department the usefullness and the "cost savings" potential that lies ahead.

Re: [GENERAL] general questions postgresql performance config

2010-01-25 Thread Craig Ringer
On 26/01/2010 12:15 AM, Dino Vliet wrote: 5) Other considerations? To get optimal performance for bulk loading you'll want to do concurrent data loading over several connections - up to as many as you have disk spindles. Each connection will individually be slower, but the overall throughp