Re: [PERFORM] [PERFORMANCE] expanding to SAN: which portion best to move

2011-05-04 Thread Willy-Bas Loos
I'm asking them for (real) benchmarks, thanks for the advice. (fio is not available for us now to do it myself, grmbl) It just occurred to me that it is not necessarily the case that reading the indexes causes a lot of random I/O (on the index itself). I mean, maybe the index is generally read seq

Re: [PERFORM] amazon ec2

2011-05-04 Thread Jim Nasby
On May 3, 2011, at 5:39 PM, Greg Smith wrote: > I've also seen over a 20:1 speedup over PostgreSQL by using Greenplum's free > Community Edition server, in situations where its column store + compression > features work well on the data set. That's easiest with an append-only > workload, and th

Re: [PERFORM] REINDEX takes half a day (and still not complete!)

2011-05-04 Thread Jim Nasby
On Apr 30, 2011, at 9:34 AM, Kenneth Marshall wrote: >> I suppose that's what I am going to do on a periodic basis from now >> on. There is a lot of DELETE/UPDATE activity. But I wonder if the >> vacuum stuff really should do something that's similar in function? >> What do the high-end enterprise

[PERFORM] row estimate very wrong for array type

2011-05-04 Thread Denis de Bernardy
Hi, I'm running into erroneous row estimates when using an array type, and I'm running out of ideas on how to steer postgres into the right direction... I've tried setting statistics to 1000, vacuuming and analyzing over and over, rewriting the query differently... to no avail. The table looks

Re: [PERFORM] amazon ec2

2011-05-04 Thread Shaun Thomas
On 05/03/2011 01:48 PM, Joel Reymont wrote: What are the best practices for setting up PG 9.x on Amazon EC2 to get the best performance? Use EC2 and other Amazon hosting for cloud-based client access only. Their shared disk services are universally despised by basically everyone who has trie

Re: [PERFORM] row estimate very wrong for array type

2011-05-04 Thread Tom Lane
Denis de Bernardy writes: > [ estimates for array && suck ] > Might this be a bug in the operator's selectivity, or am I doing something > wrong? Array && uses areasel() which is only a stub :-( In the particular case here it'd be possible to get decent answers just by trying the operator again

Re: [PERFORM] row estimate very wrong for array type

2011-05-04 Thread Denis de Bernardy
That kind of limits the usefulness of aggregating hierarchical dependencies into array columns to avoid enormous join statements. :-| Re your todo item you mention in this thread: http://archives.postgresql.org/pgsql-hackers/2010-05/msg01864.php My C is rusty, but I might have enough understan

Re: [PERFORM] row estimate very wrong for array type

2011-05-04 Thread Denis de Bernardy
> - Original Message - >> From: Tom Lane >> To: Denis de Bernardy >> Cc: "pgsql-performance@postgresql.org" > >> Sent: Wednesday, May 4, 2011 4:12 PM >> Subject: Re: [PERFORM] row estimate very wrong for array type >> >> Array && uses areasel() which is only a stub :-( On a s

Re: [PERFORM] Shouldn't we have a way to avoid "risky" plans?

2011-05-04 Thread Jim Nasby
On Mar 24, 2011, at 5:23 PM, Claudio Freire wrote: > I routinely have to work around query inefficiencies because GEQO does > something odd - and since postgres gives me too few tools to tweak > plans (increase statistics, use subqueries, rephrase joins, no direct > tool before CTEs which are rathe

Re: [PERFORM] Postgres 9.0.4 + Hot Standby + FusionIO Drive + Performance => Query failed ERROR: catalog is missing 1 attribute(s) for relid 172226

2011-05-04 Thread Josh Berkus
> While doing so I got the "*Query failed ERROR: catalog is missing 1 > attribute(s) for relid 172226*". Any idea on this error? Is that combination > PG + HotSB + Fusion IO Drive is not advisable?! What were you doing when you got this error? -- Josh Berkus PostgreSQL Experts Inc. http://pgexp

Re: [PERFORM] amazon ec2

2011-05-04 Thread Josh Berkus
> FWIW, EnterpriseDB's "InfiniCache" provides the same caching benefit. The way > that works is when PG goes to evict a page from shared buffers that page gets > compressed and stuffed into a memcache cluster. When PG determines that a > given page isn't in shared buffers it will then check tha

Re: [PERFORM] amazon ec2

2011-05-04 Thread david
On Wed, 4 May 2011, Josh Berkus wrote: Date: Wed, 04 May 2011 17:02:53 -0700 From: Josh Berkus To: postgres performance list Subject: Re: [PERFORM] amazon ec2 FWIW, EnterpriseDB's "InfiniCache" provides the same caching benefit. The way that works is when PG goes to evict a page from share

Re: [PERFORM] amazon ec2

2011-05-04 Thread Denis de Bernardy
- Original Message - > From: Josh Berkus > To: postgres performance list > Cc: > Sent: Thursday, May 5, 2011 2:02 AM > Subject: Re: [PERFORM] amazon ec2 > So memcached basically replaces the filesystem? > > That sounds cool, but I'm wondering if it's actually a performance > speedup. 

[PERFORM] ask the database engine tuning on the server

2011-05-04 Thread Didik Prasetyo
I had a problem with performance engine database, I use the server with the following specifications 1. its storage configuration? Storage SCSI 15K RAID 5 2. how his network? 2 gigabit bonding. 3. type / behavior of applications that connect to the db? Direct connects one s

[PERFORM] Explicit joins

2011-05-04 Thread Rishabh Kumar Jain
I referred chapter 14.3 of postgres document version 9.0. explicit joins help the planner in planninng & thus improve performance. On what relations are explicit joins to be added?? I am getting data from 10 tables in a view. I don't know on which pair of tables I have to add explicit joins to im