Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Vinubalaji Gopal
> > I think you will find if you do it the right way, which is to say the > way that it is meant to be done with the configurable options, your > life will be a great deal more pleasant than some one off hack. > yeah I agree. The pg_maintanence script which calls vacuum and analyze is the one o

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Vinubalaji Gopal
On Fri, 2008-03-14 at 18:37 -0700, Tom Lane wrote: > That's only a little bit better. Read about all the bug fixes you're Sure - will eventually upgrade it sometime - but it has to wait for now :( -- Vinu -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To make c

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Joshua D. Drake
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Fri, 14 Mar 2008 17:51:52 -0800 Vinubalaji Gopal <[EMAIL PROTECTED]> wrote: > Hi Joshua, > > > You can use parameters such as vacuum_cost_delay to help this... see > > the docs: > > > > http://www.postgresql.org/docs/8.3/static/runtime-config-aut

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Tom Lane
Vinubalaji Gopal <[EMAIL PROTECTED]> writes: >> If you are truly running 8.0 and not something like 8.0.15 vacuum is >> the least of your worries. > Its 8.0.4. That's only a little bit better. Read about all the bug fixes you're missing at http://www.postgresql.org/docs/8.0/static/release.html

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Vinubalaji Gopal
Hi Joshua, > You can use parameters such as vacuum_cost_delay to help this... see > the docs: > > http://www.postgresql.org/docs/8.3/static/runtime-config-autovacuum.html I am checking it out. Seems to be a nice option for vacuum - but wish there was a way to change the delete priority or I will

Re: [PERFORM] best way to run maintenance script

2008-03-14 Thread Joshua D. Drake
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Fri, 14 Mar 2008 17:00:21 -0800 Vinubalaji Gopal <[EMAIL PROTECTED]> wrote: > Hi all, > I have been searching for the best way to run maintenance scripts > which does a vacuum, analyze and deletes some old data. Whenever the > maintenance script

[PERFORM] best way to run maintenance script

2008-03-14 Thread Vinubalaji Gopal
Hi all, I have been searching for the best way to run maintenance scripts which does a vacuum, analyze and deletes some old data. Whenever the maintenance script runs - mainly the pg_maintenance --analyze script - it slows down postgresql inserts and I want to avoid that. The system is under cons

Re: [PERFORM] Adaptec 5805 SAS Raid

2008-03-14 Thread Leigh Dyer
Glyn Astill wrote: Any of you chaps used this controller? It looks very similar to the rebadged Adaptec that Sun shipped in the X4150 I ordered a few weeks ago, though the Sun model had only 256MB of cache RAM. I was wary of going Adaptec after my experiences with the PERC/3i, which couldn'

Re: [PERFORM] Anyone using a SAN?

2008-03-14 Thread Peter Koczan
Hi all, I had a few meetings with SAN vendors and I thought I'd give you some follow-up on points of potential interest. - Dell/EMC The representative was like the Dell dude grown up. The sales pitch mentioned "price point" about twenty times (to the point where it was annoying), and the pitch ul

Re: [PERFORM] The "many nulls" problem

2008-03-14 Thread Oleg Bartunov
On Fri, 14 Mar 2008, Kynn Jones wrote: On Fri, Mar 14, 2008 at 2:59 PM, Oleg Bartunov <[EMAIL PROTECTED]> wrote: have you seen contrib/hstore ? You can have one table with common attributes and hide others in hstore That's interesting. I'll check it out. Thanks! actually, hstore was des

Re: [PERFORM] The "many nulls" problem

2008-03-14 Thread Kynn Jones
On Fri, Mar 14, 2008 at 2:59 PM, Oleg Bartunov <[EMAIL PROTECTED]> wrote: > have you seen contrib/hstore ? You can have one table with common > attributes > and hide others in hstore > That's interesting. I'll check it out. Thanks! Kynn

Re: [PERFORM] The "many nulls" problem

2008-03-14 Thread Kynn Jones
On Fri, Mar 14, 2008 at 3:46 PM, Heikki Linnakangas <[EMAIL PROTECTED]> wrote: > > > From performance point of view, I would go with a single table with > NULL fields on PostgreSQL. Wow. I'm so glad I asked! Thank you very much! Kynn

Re: [PERFORM] The "many nulls" problem

2008-03-14 Thread Heikki Linnakangas
Kynn Jones wrote: In all these cases, the design choice, at least according to RDb's 101, is between including a column in the table that will be NULL most of the time, or defining a second auxiliary column that references the first one and holds the non-redundant information for the minority of

Re: [PERFORM] Hardware question for a DB server

2008-03-14 Thread Scott Marlowe
On Fri, Mar 14, 2008 at 1:24 PM, Pascal Cohen <[EMAIL PROTECTED]> wrote: > I agree with what you are saying. We are using Java with a pool of > connections to access the DB. Today our database is really small > compared to the RAM but it may evolve and even will probably grow (hope > so which w

Re: [PERFORM] Hardware question for a DB server

2008-03-14 Thread Pascal Cohen
Greg Smith wrote: On Wed, 12 Mar 2008, Mark Lewis wrote: One question that's likely going to be important depending on your answers above is whether or not you're getting a battery-backed write cache for that ServeRAID-8K. Apparently there's a 8k-l and an regular 8-k; the l doesn't have the

Re: [PERFORM] The "many nulls" problem

2008-03-14 Thread Oleg Bartunov
Kynn, have you seen contrib/hstore ? You can have one table with common attributes and hide others in hstore Oleg On Fri, 14 Mar 2008, Kynn Jones wrote: It often happens that a particular pieces of information is non-null for a small minority of cases. A superficially different manifestation

[PERFORM] The "many nulls" problem

2008-03-14 Thread Kynn Jones
It often happens that a particular pieces of information is non-null for a small minority of cases. A superficially different manifestation of this is when two pieces of information are identical in all but a small minority of cases. This can be easily mapped to the previous description by defini

[PERFORM] Adaptec 5805 SAS Raid

2008-03-14 Thread Glyn Astill
Any of you chaps used this controller? ___ Rise to the challenge for Sport Relief with Yahoo! For Good http://uk.promotions.yahoo.com/forgood/ -- Sent via pgsql-performance mailing list (pgsql-performance@postgresql.org) To mak

Re: [PERFORM] Lots of "semop" calls under load

2008-03-14 Thread Tom Lane
"Albe Laurenz" <[EMAIL PROTECTED]> writes: > On a database (PostgreSQL 8.2.4 on 64-bit Linux 2.6.18 on 8 AMD Opterons) > that is under high load, I observe the following: > ... > - "vmstat" shows that CPU time is divided between "idle" and "iowait", > with user and sys time practically zero. > -

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Michael Stone
On Thu, Mar 13, 2008 at 05:27:09PM -0400, Greg Smith wrote: I haven't found fdatasync to be significantly better in my tests on Linux but I never went out of my way to try and quantify it. My understanding is that some of the write barrier implementation details on ext3 filesystems make any sy

[PERFORM] Lots of "semop" calls under load

2008-03-14 Thread Albe Laurenz
On a database (PostgreSQL 8.2.4 on 64-bit Linux 2.6.18 on 8 AMD Opterons) that is under high load, I observe the following: - About 200 database sessions concurrently issue queries, most of them small, but I have found one that touches 38000 table and index blocks. - "vmstat" shows that CPU time

Re: [PERFORM] ER diagram tool

2008-03-14 Thread sathiya psql
> > 14:31 < rtfm_please> For information about erd > 14:31 < rtfm_please> see http://druid.sf.net/ > 14:31 < rtfm_please> or http://schemaspy.sourceforge.net/ A very great Thanks. SchemaSpy drawn ER diagram by referring my database... it done a very good job Thanks a lot GUY

Re: [PERFORM] ER diagram tool

2008-03-14 Thread Jurgen Haan
ERStudio Toad Data Modeller And you might try searching sourceforge or freshmeat. sathiya psql wrote: > Is there any tool to draw ER diagram from SQL schema file... > > > no other groups are replying. -- Easyflex diensten b.v. Acaciastraat 16 4921 MA MADE T: 0162 - 690410 F: 0162 - 69041

Re: [PERFORM] 8.3 write performance

2008-03-14 Thread Enrico Sirola
Hi, I follow up myself: I was using pgbench with the wrong scale size. With the configuration I posted before and scale=100 I Get the following: sudo -u postgres pgbench -c 10 -t 1 -s 100 starting vacuum...end. transaction type: TPC-B (sort of) scaling factor: 100 number of clients: 10 n

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Justin
Greg Smith wrote: On Fri, 14 Mar 2008, Justin wrote: I played with shared_buffer and never saw much of an improvement from 100 all the way up to 800 megs moved the checkpoints from 3 to 30 and still never saw no movement in the numbers. Increasing shared_buffers normally improves performan

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Greg Smith
On Fri, 14 Mar 2008, Justin wrote: I played with shared_buffer and never saw much of an improvement from 100 all the way up to 800 megs moved the checkpoints from 3 to 30 and still never saw no movement in the numbers. Increasing shared_buffers normally improves performance as the size of the

Re: [PERFORM] Benchmark: Dell/Perc 6, 8 disk RAID 10

2008-03-14 Thread Justin
Is this on a 64 bit or 32 bit machine? We had the problem with a 32 bit linux box (not sure what flavor) just a few months ago. I would not create a filesystem on a partition of 2+TB Yes this machine is 64bit You do know that effective_cache_size is the size of the OS level cache. i.e. i