Re: [PERFORM] VACUUM Performance

2006-10-20 Thread Tom Lane
"Steve Oualline" <[EMAIL PROTECTED]> writes: > Question: I have a big table with 120,000,000 records. > Let's assume that I DELETE 4,000,000 records, VACUUM FULL, and REINDEX. > Now I have the same table, but with 240,000,000 records. > I DELETE 8,000,000 records, VACUUM FULL, and REINDEX. > Shou

Re: [PERFORM] Is ODBC that slow?

2006-10-20 Thread Joshua D. Drake
>> > ODBC is often blamed for this sort of thing - I have the 8.01.02 >> release >> > dated 2006.01.31. Everything appears to be at its default setting. >> >> Try Command Prompt's ODBC driver. Lately it has been measured to be >> consistently faster than psqlODBC. I should note that we need to

Re: [PERFORM] Is ODBC that slow?

2006-10-20 Thread Joshua D. Drake
>> Try Command Prompt's ODBC driver. Lately it has been measured to be >> consistently faster than psqlODBC. >> >> http://projects.commandprompt.com/public/odbcng > > just curious: what was the reasoning to reimplement the protocol stack > in odbcng? the mainline odbc driver went in the other di

Re: [PERFORM] Slow functional indexes?

2006-10-20 Thread Tom Lane
Stuart Bishop <[EMAIL PROTECTED]> writes: > I would like to understand what causes some of my indexes to be slower to > use than others with PostgreSQL 8.1. I was about to opine that it was all about different levels of correlation between the index order and physical table order ... but your expe

Re: [PERFORM] Is ODBC that slow?

2006-10-20 Thread Merlin Moncure
On 10/21/06, Alvaro Herrera <[EMAIL PROTECTED]> wrote: Carlo Stonebanks wrote: > Our Windows-based db server has to integrate with users that work regularily > with Access.When attempting to import user's data from Access MDB files to > PostgreSQL, we try on eof two things: either import using EM

Re: [PERFORM] Slow functional indexes?

2006-10-20 Thread Merlin Moncure
On 10/20/06, Stuart Bishop <[EMAIL PROTECTED]> wrote: I would like to understand what causes some of my indexes to be slower to use than others with PostgreSQL 8.1. On a particular table, I have an int4 primary key, an indexed unique text 'name' column and a functional index of type text. The fun

Re: [PERFORM] Is ODBC that slow?

2006-10-20 Thread Alvaro Herrera
Carlo Stonebanks wrote: > Our Windows-based db server has to integrate with users that work regularily > with Access.When attempting to import user's data from Access MDB files to > PostgreSQL, we try on eof two things: either import using EMS SQL Manager's > Data Import from Access utility, or

Re: [PERFORM] Best COPY Performance

2006-10-20 Thread Merlin Moncure
On 10/21/06, Worky Workerson <[EMAIL PROTECTED]> wrote: What is the best COPY performance that you have gotten on a "normal" table? I know that this is question is almost too general, but it might help me out a bit, or at least give me the right things to tweak. Perhaps the question can be rewr

Re: [PERFORM] Is ODBC that slow?

2006-10-20 Thread Merlin Moncure
On 10/21/06, Carlo Stonebanks <[EMAIL PROTECTED]> wrote: Our Windows-based db server has to integrate with users that work regularily with Access.When attempting to import user's data from Access MDB files to PostgreSQL, we try on eof two things: either import using EMS SQL Manager's Data Import

[PERFORM] Vacuum and Memory Loss

2006-10-20 Thread Mike
Hello friends, I am responsible for maintaining a high volume website using postgresql 8.1.4. Given the amount of reads and writes, I vacuum full the server a few times a week around 1, 2 AM shutting down the site for a few minutes. The next day morning around 10 - 11 AM the server slows down to d

[PERFORM] Slow functional indexes?

2006-10-20 Thread Stuart Bishop
I would like to understand what causes some of my indexes to be slower to use than others with PostgreSQL 8.1. On a particular table, I have an int4 primary key, an indexed unique text 'name' column and a functional index of type text. The function (person_sort_key()) is declared IMMUTABLE and RETU

[PERFORM] Jdbc/postgres performance

2006-10-20 Thread Behl, Rohit \(Infosys\)
Title: Jdbc/postgres performance Hi We are facing performance problems in postgres while executing a query. When I execute this query on the server it takes 5-10 seconds. Also I get good performance while executing this query from my code in java with the hard codes values. I face severe per

Re: [HACKERS] [PERFORM] Hints proposal

2006-10-20 Thread Mischa Sandberg
-Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Bucky Jordan Sent: Thursday, October 12, 2006 2:19 PM To: josh@agliodbs.com; Jim C. Nasby Cc: pgsql-hackers@postgresql.org; pgsql-performance@postgresql.org Subject: Re: [HACKERS] [PERFORM] Hints proposal >

Re: [HACKERS] [PERFORM] Hints proposal

2006-10-20 Thread Gregory Stark
Josh Berkus writes: >> > I actually think the way to attack this issue is to discuss the kinds >> > of errors the planner makes, and what tweaks we could do to correct >> > them. Here's the ones I'm aware of: >> > >> > -- Incorrect selectivity of WHERE clause >> > -- Incorrect selectivity of JOIN

Re: [HACKERS] [PERFORM] Hints proposal

2006-10-20 Thread Zeugswetter Andreas ADI SD
> I actually think the way to attack this issue is to discuss the kinds of errors the planner makes, and what tweaks we could do to correct them. > Here's the ones I'm aware of: > > -- Incorrect selectivity of WHERE clause > -- Incorrect selectivity of JOIN > -- Wrong estimate of rows returned f

[PERFORM] Is ODBC that slow?

2006-10-20 Thread Carlo Stonebanks
Our Windows-based db server has to integrate with users that work regularily with Access.When attempting to import user's data from Access MDB files to PostgreSQL, we try on eof two things: either import using EMS SQL Manager's Data Import from Access utility, or export from Access to Postgresql

[PERFORM] VACUUM Performance

2006-10-20 Thread Steve Oualline
Title: VACUUM Performance Question:   I have a big table with 120,000,000 records. Let's assume that I DELETE 4,000,000 records, VACUUM FULL, and REINDEX. Now I have the same table, but with 240,000,000 records. I DELETE 8,000,000 records, VACUUM FULL, and REINDEX. Should the second

Re: [PERFORM] New hardware thoughts

2006-10-20 Thread alvis
Hi Ben , You mentioned a "Perc" controller, so I'll assume this is a Dell. My advice is to find another supplier. check the archives for Dell. Basically you have no idea what the Perc controller is since it is whatever Dell decides to ship that day. In general though you are going down the

Re: [PERFORM] New hardware thoughts

2006-10-20 Thread Ben Suffolk
Yes I am looking at either the 2950 or the 6850. I think the only think that the 6850 really offers me over the 2950 is more expandability in the spare processor, and additional memory I see (in first mail) you plan to use bsd 6.1 on dell2950. --- flame on Off topic for postgresql performance

[PERFORM] Best COPY Performance

2006-10-20 Thread Worky Workerson
What is the best COPY performance that you have gotten on a "normal" table? I know that this is question is almost too general, but it might help me out a bit, or at least give me the right things to tweak. Perhaps the question can be rewritten as "Where are the major bottlenecks in a COPY?" or

Re: [PERFORM] New hardware thoughts

2006-10-20 Thread Joshua D. Drake
Ben Suffolk wrote: >> You mentioned a "Perc" controller, so I'll assume this is a Dell. >> >> My advice is to find another supplier. check the archives for Dell. >> >> Basically you have no idea what the Perc controller is since it is >> whatever Dell decides to ship that day. >> >> In general thou

Re: [PERFORM] New hardware thoughts

2006-10-20 Thread Ben Suffolk
You mentioned a "Perc" controller, so I'll assume this is a Dell. My advice is to find another supplier. check the archives for Dell. Basically you have no idea what the Perc controller is since it is whatever Dell decides to ship that day. In general though you are going down the right path

Re: [PERFORM] New hardware thoughts

2006-10-20 Thread Ben Suffolk
Cheers Shane, Sounds like you have a very good idea of what to expect. Are these solid stats or certain estimates? Estimates can vary when it comes time to start. The figures all come from how my application interacts with the database when an event happens, so the scaling of operations t

Re: [PERFORM] New hardware thoughts

2006-10-20 Thread Dave Cramer
Ben, On 20-Oct-06, at 3:49 AM, Ben Suffolk wrote: Hello all, I am currently working out the best type of machine for a high volume pgsql database that I going to need for a project. I will be purchasing a new server specifically for the database, and it won't be running any other applica

Re: [PERFORM] New hardware thoughts

2006-10-20 Thread Shane Ambler
Ben Suffolk wrote: Hello all, I am currently working out the best type of machine for a high volume pgsql database that I going to need for a project. I will be purchasing a new server specifically for the database, and it won't be running any other applications. I will be using FreeBSD 6.1 S

Re: [PERFORM] measuring shared memory usage on Windows

2006-10-20 Thread David Boreham
Unfortunately often operating system virtual memory and filesystem caching code that does exactly the opposite of what a database application would like. For some reason the kernel guys don't see it that way ;) Over the years there have been various kernel features added with the overall goal of

Re: [PERFORM] Swappiness setting on a linux pg server

2006-10-20 Thread Tobias Brox
[Jim C. Nasby - Thu at 11:31:26AM -0500] > The issue with pg_xlog is you don't need bandwidth... you need super-low > latency. The best way to accomplish that is to get a battery-backed RAID > controller that you can enable write caching on. In fact, if the > controller is good enough, you can theo

Re: [PERFORM] VACUUM FULL ANALYZE on 8.1.4 is slower then on 8.0

2006-10-20 Thread Markus Schaber
Hi, Andrzej, Andrzej Zawadzki wrote: > After upgrade PostgreSQL from 8.0 to 8.1.4 a VACUUM FULL ANALYZE > process is much slower, from logs: > > 8.0 > [13666][postgres][2006-10-06 01:13:38 CEST][1340121452] LOG: statement: > VACUUM FULL ANALYZE; > [13666][postgres][2006-10-06 01:39:15 CEST][0]

[PERFORM] pgBench on Windows

2006-10-20 Thread Harald Armin Massa
Hello Performancers,has anyone a pgBench tool running on Windows?I want to experiment with various settings to tune; and would prefer using something ready made before coming up with my own misstakes. Harald-- GHUM Harald Massapersuadere et programmareHarald Armin MassaReinsburgstraße 202b70197 Stu

Re: [PERFORM] measuring shared memory usage on Windows

2006-10-20 Thread Harald Armin Massa
Performance readers I follow up my promise:I try my theories :)) and contrary to all wisdom from all PostgreSQL tuning recommendations reconfigured shared memory nearly to theminimum: 1000 for maximum of 400 concurrent connections. (800 would beminimum). Single user performance was fine, now I

Re: [PERFORM] measuring shared memory usage on Windows

2006-10-20 Thread Harald Armin Massa
Mark,> And THAT is exactly the challenge of this thread: I am searching for > tools to check shared memory usage on Windows. ipcs is not available.> And neither Magnus nor Dave, both main contributors of the win32 port> of PostgreSQL, and both way wiser concerning Windows internas then me, > know o

[PERFORM] New hardware thoughts

2006-10-20 Thread Ben Suffolk
Hello all, I am currently working out the best type of machine for a high volume pgsql database that I going to need for a project. I will be purchasing a new server specifically for the database, and it won't be running any other applications. I will be using FreeBSD 6.1 Stable. I think