Re: [GENERAL] Query memory usage

2010-05-15 Thread Tom Duffey
On May 15, 2010, at 8:00 PM, Tom Lane wrote: Tom Duffey writes: On May 15, 2010, at 7:28 PM, Tom Lane wrote: Well, I tried executing a large "copy (select ...)" query and couldn't see any memory bloat at all in either the backend or psql. So there's something relevant that you haven't t

Re: [GENERAL] Query memory usage

2010-05-15 Thread Tom Lane
Tom Duffey writes: > On May 15, 2010, at 7:28 PM, Tom Lane wrote: >> Well, I tried executing a large "copy (select ...)" query and couldn't >> see any memory bloat at all in either the backend or psql. So there's >> something relevant that you haven't told us. > I hope you are right! The actual

Re: [GENERAL] Query memory usage

2010-05-15 Thread Tom Duffey
On May 15, 2010, at 7:28 PM, Tom Lane wrote: Tom Duffey writes: On May 15, 2010, at 4:51 PM, Tom Lane wrote: What's being done on the client side with the data? I am executing the query in psql at the command line and piping the result to a file, e.g., psql < get_data.sql > data.sql Wel

Re: [GENERAL] Query memory usage

2010-05-15 Thread Tom Lane
Tom Duffey writes: > On May 15, 2010, at 4:51 PM, Tom Lane wrote: >> What's being done on the client side with the data? > I am executing the query in psql at the command line and piping the > result to a file, e.g., > psql < get_data.sql > data.sql Well, I tried executing a large "copy (selec

Re: [GENERAL] Query memory usage

2010-05-15 Thread Tom Duffey
On May 15, 2010, at 4:51 PM, Tom Lane wrote: Tom Duffey writes: I have a table with several hundred million rows of timestamped values. Using pg_dump we are able to dump the entire table to disk no problem. However, I would like to retrieve a large subset of data from this table using so

Re: [GENERAL] Query memory usage

2010-05-15 Thread Tom Lane
Tom Duffey writes: > I have a table with several hundred million rows of timestamped > values. Using pg_dump we are able to dump the entire table to disk no > problem. However, I would like to retrieve a large subset of data > from this table using something like: > COPY (SELECT * FROM hi

Re: [GENERAL] Query memory usage

2010-05-15 Thread Karl Denninger
Tom Duffey wrote: > Hi Everyone, > > I have a table with several hundred million rows of timestamped > values. Using pg_dump we are able to dump the entire table to disk no > problem. However, I would like to retrieve a large subset of data > from this table using something like: > > COPY (SELECT

[GENERAL] Query memory usage

2010-05-15 Thread Tom Duffey
Hi Everyone, I have a table with several hundred million rows of timestamped values. Using pg_dump we are able to dump the entire table to disk no problem. However, I would like to retrieve a large subset of data from this table using something like: COPY (SELECT * FROM history WHERE ti