Re: [PERFORM] pg_dump far too slow

2010-03-21 Thread David Newall
Tom Lane wrote: I would bet that the reason for the slow throughput is that gzip is fruitlessly searching for compressible sequences. It won't find many. Indeed, I didn't expect much reduction in size, but I also didn't expect a four-order of magnitude increase in run-time (i.e. output at

Re: [PERFORM] pg_dump far too slow

2010-03-21 Thread David Newall
Thanks for all of the suggestions, guys, which gave me some pointers on new directions to look, and I learned some interesting things. The first interesting thing was that piping (uncompressed) pg_dump into gzip, instead of using pg_dump's internal compressor, does bring a lot of extra paralle

[PERFORM] pg_dump far too slow

2010-03-14 Thread David Newall
Evening all, Maiden post to this list. I've a performance problem for which I'm uncharacteristically in need of good advice. I have a read-mostly database using 51GB on an ext3 filesystem on a server running Ubuntu 9.04 and PG 8.3. Forty hours ago I started a plain-format dump, compressed