Re: [PERFORM] Performance issues with postgresql-8.4.0: Query gets stuck sometimes

2010-07-01 Thread Scott Marlowe
On Fri, Jul 2, 2010 at 1:40 AM, Sachin Kumar wrote: > Hi, > > We are using postgresql-8.4.0 on 64-bit Linux machine (open-SUSE 11.x). It’s > a master/slave deployment & slony-2.0.4.rc2 is used for DB replication (from > master to slave). You should really be running 8.4.4, not 8.4.0, as there are

[PERFORM] Performance issues with postgresql-8.4.0: Query gets stuck sometimes

2010-07-01 Thread Sachin Kumar
Hi, We are using postgresql-8.4.0 on 64-bit Linux machine (open-SUSE 11.x). It's a master/slave deployment & slony-2.0.4.rc2 is used for DB replication (from master to slave). At times we have observed that postgres stops responding for several minutes, even couldn't fetch the number of en

Re: [PERFORM] big data - slow select (speech search)

2010-07-01 Thread Michal Fapso
I forgot to mention one thing. If you want to generate data using the perl script, do this: perl create_synthetic_data.pl > synthetic_data.sqlcopy and then after you create the 'hyps' table, use the COPY command with the generated file: COPY hyps FROM '/the/full/path/synthetic_data.sqlcopy

Re: [PERFORM] Highly Efficient Custom Sorting

2010-07-01 Thread Tom Lane
Craig Ringer writes: > On 02/07/10 08:46, Eliot Gable wrote: >> So, the bottom line is, I need a faster way to do this sorting. > You haven't showed us how you're doing it at the moment, so it's awfully > hard to comment usefully on possible approaches. I'm guessing from tea leaves, but the imp

Re: [PERFORM] No hash join across partitioned tables?

2010-07-01 Thread Tom Lane
Bruce Momjian writes: > Tom Lane wrote: >> I would have liked to get to this for 9.0 but I feel it's a bit late >> now. > What do we want to do about the above issue? TODO item. regards, tom lane -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.

Re: [PERFORM] Highly Efficient Custom Sorting

2010-07-01 Thread Craig Ringer
On 02/07/10 08:46, Eliot Gable wrote: > So, the bottom line is, I need a faster way to do this sorting. You haven't showed us how you're doing it at the moment, so it's awfully hard to comment usefully on possible approaches. -- Craig Ringer Tech-related writing: http://soapyfrogs.blogspot.co

Re: [PERFORM] how to (temporarily) disable/minimize benefits of disk block cache or postgresql shared buffer

2010-07-01 Thread Craig Ringer
On 02/07/10 01:59, Rajesh Kumar Mallah wrote: > I had set it to 128kb > it does not really work , i even tried your next suggestion. I am in > virtualized > environment particularly OpenVz. where echo 3 > /proc/sys/vm/drop_caches > does not work inside the virtual container, i did it in the hardwa

Re: [PERFORM] No hash join across partitioned tables?

2010-07-01 Thread Bruce Momjian
Tom Lane wrote: > Robert Haas writes: > > In going back through emails I had marked as possibly needing another > > look before 9.0 is released, I came across this issue again. As I > > understand it, analyze (or analyse) now collects statistics for both > > the parent individually, and for the p

[PERFORM] Highly Efficient Custom Sorting

2010-07-01 Thread Eliot Gable
I have a long stored procedure (over 3,000 lines). Originally, it would take about 44ms to run the whole query. After lots and lots of tweaking, Postgres now runs the entire thing and gathers my results in just 15.2ms, which is very impressive given the hardware this is running on. Now, I used to r

[PERFORM] big data - slow select (speech search)

2010-07-01 Thread Michal Fapso
Hi, I have quite a simple query but a lot of data and the SELECT query is too slow. I will be really grateful for any advice on this. -- The background info: I work on a speech search engine which differs from text search in having more words (hypo

Re: [PERFORM] how to (temporarily) disable/minimize benefits of disk block cache or postgresql shared buffer

2010-07-01 Thread Rajesh Kumar Mallah
On Thu, Jul 1, 2010 at 10:07 PM, Craig Ringer wrote: > On 01/07/10 17:41, Rajesh Kumar Mallah wrote: > > Hi, > > > > this is not really a performance question , sorry if its bit irrelevant > > to be posted here. We have a development environment and we want > > to optimize the non-database parts o

Re: [PERFORM] how to (temporarily) disable/minimize benefits of disk block cache or postgresql shared buffer

2010-07-01 Thread Craig Ringer
On 01/07/10 17:41, Rajesh Kumar Mallah wrote: > Hi, > > this is not really a performance question , sorry if its bit irrelevant > to be posted here. We have a development environment and we want > to optimize the non-database parts of the application. The problem is > that subsequent run of queri

Re: [PERFORM] optimal ZFS filesystem on JBOD layout

2010-07-01 Thread Greg Smith
Joachim Worringen wrote: Potential issues that I see: - the ZFS ZIL will not benefit from a BBU (as it is connected to the backplane, driven by the onboard-RAID), and might be too small (32GB for ~2TB of data with lots of writes)? This is a somewhat unpredictable setup. The conservative appr

[PERFORM] optimal ZFS filesystem on JBOD layout

2010-07-01 Thread Joachim Worringen
Greetings, we are running a few databases of currently 200GB (growing) in total for data warehousing: - new data via INSERTs for (up to) millions of rows per day; sometimes with UPDATEs - most data in a single table (=> 10 to 100s of millions of rows) - queries SELECT subsets of this table via

Re: [PERFORM] What is the best way to optimize this query

2010-07-01 Thread Thom Brown
On 1 July 2010 06:19, Srikanth Kata wrote: > > Please tell me What is the best way to optimize this query > > select > s.*,a.actid,a.phone,d.domid,d.domname,d.domno,a.actno,a.actname,p.descr > as svcdescr from vwsubsmin s inner join packages p on s.svcno=p.pkgno inner > join > account a on a.actno

Re: [PERFORM] What is the best way to optimize this query

2010-07-01 Thread Rajesh Kumar Mallah
Dear Sri, Please post at least the Explain Analyze output . There is a nice posting guideline also regarding on how to post query optimization questions. http://wiki.postgresql.org/wiki/SlowQueryQuestions On Thu, Jul 1, 2010 at 10:49 AM, Srikanth Kata wrote: > > Please tell me What is the best

[PERFORM] What is the best way to optimize this query

2010-07-01 Thread Srikanth Kata
Please tell me What is the best way to optimize this query select s.*,a.actid,a.phone,d.domid,d.domname,d.domno,a.actno,a.actname,p.descr as svcdescr from vwsubsmin s inner join packages p on s.svcno=p.pkgno inner join account a on a.actno=s.actno inner join ssgdom d on a.domno=d.domno inner join

Re: [PERFORM] Extremely high CPU usage when building tables

2010-07-01 Thread Rajesh Kumar Mallah
Hi, 1. Did you also check vmstat output , from sar output the i/o wait is not clear. 2. i gues you must be populating the database between creating tables and creating indexes. creating indexes require sorting of data that may be cpu intensive, loading/populating the data may saturate t

[PERFORM] how to (temporarily) disable/minimize benefits of disk block cache or postgresql shared buffer

2010-07-01 Thread Rajesh Kumar Mallah
Hi, this is not really a performance question , sorry if its bit irrelevant to be posted here. We have a development environment and we want to optimize the non-database parts of the application. The problem is that subsequent run of queries are execute very fast and makes the performance analysi