Re: [HACKERS] array_agg() NULL Handling

2010-08-31 Thread Thom Brown
On 1 September 2010 06:45, David E. Wheeler wrote: > The aggregate docs say: > >> The first form of aggregate expression invokes the aggregate across all >> input rows for which the given expression(s) yield non-null values. >> (Actually, it is up to the aggregate function whether to ignore null

Re: [HACKERS] english parser in text search: support for multiple words in the same position

2010-08-31 Thread Sushant Sinha
I have attached a patch that emits parts of a host token, a url token, an email token and a file token. Further, it makes sure that a host/url/email/file token and the first part-token are at the same position in tsvector. The two major changes are: 1. Tokenization changes: The patch exploits the

[HACKERS] array_agg() NULL Handling

2010-08-31 Thread David E. Wheeler
The aggregate docs say: > The first form of aggregate expression invokes the aggregate across all input > rows for which the given expression(s) yield non-null values. (Actually, it > is up to the aggregate function whether to ignore null values or not — but > all the standard ones do.) -- ht

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Heikki Linnakangas
On 01/09/10 04:02, Robert Haas wrote: See the thread on interruptible sleeps. The problem right now is that there are some polling loops that act to throttle the maximum rate at which a node doing sync rep can make forward progress, independent of the capabilities of the hardware. To be preci

Re: [HACKERS] string function - "format" function proposal

2010-08-31 Thread Pavel Stehule
2010/9/1 Itagaki Takahiro : > On Wed, Sep 1, 2010 at 6:07 AM, Pavel Stehule wrote: >> I don't found a nice mix for placeholders and positional placeholders > > How about %pos$format, used in C-printf()? It might be > only in Linux's libc. > > printf("<%2$s> <%1$d>\n", 123, "abc"); > => <123> > ht

Re: [HACKERS] string function - "format" function proposal

2010-08-31 Thread Pavel Stehule
2010/9/1 David Fetter : > On Tue, Aug 31, 2010 at 11:07:40PM +0200, Pavel Stehule wrote: >> Hello >> >> attached WIP patch. > > I don't see it attached.  Is it just me? sorry, it was at 1 ofter midnight Regards Pavel > > Cheers, > David. > -- > David Fetter http://fetter.org/ > Phone: +1 415 2

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread fazool mein
Thanks! I'll wait for the merging then; there is no point in benchmarking otherwise. Regards On Tue, Aug 31, 2010 at 6:06 PM, Fujii Masao wrote: > On Wed, Sep 1, 2010 at 9:34 AM, Robert Haas wrote: > >> There are patches, and the latest from Fujii Masao is probably worth > >> looking at :) >

Re: [HACKERS] [BUGS] Estimation of Plan quality

2010-08-31 Thread Robert Haas
First, this is not a bug. Don't post to pgsql-bugs unless you're reporting a bug. On Tue, Aug 31, 2010 at 4:38 AM, vamsi krishna wrote: > Can someone tell me how to estimate the quality of my plan. For example if > the ideal query plan generated by Dynamic Programming has a plan quality of > 1.0

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Fujii Masao
On Wed, Sep 1, 2010 at 9:34 AM, Robert Haas wrote: >> There are patches, and the latest from Fujii Masao is probably worth >> looking at :) > > I am pretty sure, however, that the performance will be terrible at > this point.  Heikki is working on fixing that, but it ain't done yet. Yep. The late

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Robert Haas
On Tue, Aug 31, 2010 at 8:45 PM, David Fetter wrote: >> I am pretty sure, however, that the performance will be terrible at >> this point.  Heikki is working on fixing that, but it ain't done >> yet. > > Is this something for an eDB feature, or for community PostgreSQL, > or...? It's an EDB featu

Re: [HACKERS] string function - "format" function proposal

2010-08-31 Thread Itagaki Takahiro
On Wed, Sep 1, 2010 at 6:07 AM, Pavel Stehule wrote: > I don't found a nice mix for placeholders and positional placeholders How about %pos$format, used in C-printf()? It might be only in Linux's libc. printf("<%2$s> <%1$d>\n", 123, "abc"); => <123> http://linux.die.net/man/3/printf > %i ... s

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread David Fetter
On Tue, Aug 31, 2010 at 08:34:31PM -0400, Robert Haas wrote: > On Tue, Aug 31, 2010 at 6:24 PM, David Fetter wrote: > > On Tue, Aug 31, 2010 at 05:44:15PM -0400, Bruce Momjian wrote: > >> fazool mein wrote: > >> > Hello everyone, > >> > > >> > I'm interested in benchmarking synchronous replication

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Robert Haas
On Tue, Aug 31, 2010 at 6:24 PM, David Fetter wrote: > On Tue, Aug 31, 2010 at 05:44:15PM -0400, Bruce Momjian wrote: >> fazool mein wrote: >> > Hello everyone, >> > >> > I'm interested in benchmarking synchronous replication, to see how >> > performance degrades compared to asynchronous streaming

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Robert Haas
On Tue, Aug 31, 2010 at 6:24 PM, David Fetter wrote: > On Tue, Aug 31, 2010 at 05:44:15PM -0400, Bruce Momjian wrote: >> fazool mein wrote: >> > Hello everyone, >> > >> > I'm interested in benchmarking synchronous replication, to see how >> > performance degrades compared to asynchronous streaming

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Robert Haas
On Tue, Aug 31, 2010 at 5:07 PM, Magnus Hagander wrote: > On Tue, Aug 31, 2010 at 19:46, Magnus Hagander wrote: >> On Tue, Aug 31, 2010 at 19:44, Tom Lane wrote: >>> Magnus Hagander writes: Ok. I've got a new migration runinng. Here's the revisions removed: RCS file: /usr/local/cvsroo

Re: [HACKERS] Performance Farm Release

2010-08-31 Thread Andrew Dunstan
On 08/31/2010 03:28 AM, Greg Smith wrote: 1) Nail down what subset of the information gathered locally should be uploaded to the buildfarm master server. Probably just the same columns of data already being saved for each test, but perhaps with some extra metadata. The local animal will a

Re: [HACKERS] string function - "format" function proposal

2010-08-31 Thread David Fetter
On Tue, Aug 31, 2010 at 11:07:40PM +0200, Pavel Stehule wrote: > Hello > > attached WIP patch. I don't see it attached. Is it just me? Cheers, David. -- David Fetter http://fetter.org/ Phone: +1 415 235 3778 AIM: dfetter666 Yahoo!: dfetter Skype: davidfetter XMPP: david.fet...@gmail.co

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread David Fetter
On Tue, Aug 31, 2010 at 05:44:15PM -0400, Bruce Momjian wrote: > fazool mein wrote: > > Hello everyone, > > > > I'm interested in benchmarking synchronous replication, to see how > > performance degrades compared to asynchronous streaming replication. > > > > I browsed through the archive of emai

[HACKERS] experimental: TSearch dictionary [de]serialization

2010-08-31 Thread Pavel Stehule
Hello I wrote a some very primitive code for testing serialization and de serialization of TSearch ISpell dictionary. This code working - but it is useful only for speed test now. Czech fulltext dictionary is serialized to cca 9MB long file. Saving needs about 90ms and reading needs same time.

Re: [HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread Bruce Momjian
fazool mein wrote: > Hello everyone, > > I'm interested in benchmarking synchronous replication, to see how > performance degrades compared to asynchronous streaming replication. > > I browsed through the archive of emails, but things still seem unclear. Do > we have a final agreed upon patch tha

[HACKERS] Synchronous replication - patch status inquiry

2010-08-31 Thread fazool mein
Hello everyone, I'm interested in benchmarking synchronous replication, to see how performance degrades compared to asynchronous streaming replication. I browsed through the archive of emails, but things still seem unclear. Do we have a final agreed upon patch that I can use? Any links for that?

Re: [HACKERS] string function - "format" function proposal

2010-08-31 Thread A.M.
On Aug 31, 2010, at 5:07 PM, Pavel Stehule wrote: > Hello > > attached WIP patch. > > I implement only basic format's tags related to SQL: string, value, > literal, sql identifier. These tags are basic, but there are not any > break to implement any other formats or enhance a syntax. The mix wi

Re: [HACKERS] string function - "format" function proposal

2010-08-31 Thread Pavel Stehule
Hello attached WIP patch. I implement only basic format's tags related to SQL: string, value, literal, sql identifier. These tags are basic, but there are not any break to implement any other formats or enhance a syntax. The mix with to_char function is more complex then I expected - so I don't t

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Magnus Hagander
On Tue, Aug 31, 2010 at 19:46, Magnus Hagander wrote: > On Tue, Aug 31, 2010 at 19:44, Tom Lane wrote: >> Magnus Hagander writes: >>> Ok. I've got a new migration runinng. Here's the revisions removed: >>> RCS file: /usr/local/cvsroot/pgsql/src/backend/parser/Attic/gram.c,v >>> deleting revision

Re: [HACKERS] pg_resetxlog display bogosity

2010-08-31 Thread Tom Lane
Alvaro Herrera writes: > I wonder if pg_resetxlog should display the actual pg_control values in > one section, and the values that would be set after a reset in a > different section, so that it is extra clear. Seems reasonable, although I'd suggest labeling the first section as "Current pg_cont

Re: [HACKERS] Assertion failure on HEAD (or at least git copy of it)

2010-08-31 Thread Robert Haas
On Mon, Aug 30, 2010 at 12:47 PM, Tom Lane wrote: > I wrote: >> I guess that something isn't properly setting up rnode.backend in >> recovery processing, but didn't find it yet. > > CreateFakeRelcacheEntry is the culprit ... Thanks for the fix. -- Robert Haas EnterpriseDB: http://www.enterprise

[HACKERS] pg_resetxlog display bogosity

2010-08-31 Thread Alvaro Herrera
I just noticed that if I specify pg_resetxlog a timeline ID with the -l switch, it will display this value as "TimeLineID of latest checkpoint". Which is not really the truth. I wonder if pg_resetxlog should display the actual pg_control values in one section, and the values that would be set afte

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Magnus Hagander
On Tue, Aug 31, 2010 at 19:44, Tom Lane wrote: > Magnus Hagander writes: >> Ok. I've got a new migration runinng. Here's the revisions removed: >> RCS file: /usr/local/cvsroot/pgsql/src/backend/parser/Attic/gram.c,v >> deleting revision 2.88 >> RCS file: /usr/local/cvsroot/pgsql/src/interfaces/ec

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Tom Lane
Magnus Hagander writes: > Ok. I've got a new migration runinng. Here's the revisions removed: > RCS file: /usr/local/cvsroot/pgsql/src/backend/parser/Attic/gram.c,v > deleting revision 2.88 > RCS file: /usr/local/cvsroot/pgsql/src/interfaces/ecpg/preproc/Attic/pgc.c,v > deleting revision 1.2 > RCS

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Magnus Hagander
On Tue, Aug 31, 2010 at 17:12, Tom Lane wrote: > Magnus Hagander writes: >> On Mon, Aug 30, 2010 at 05:03, Robert Haas wrote: cvs admin -o ? >>> >>> Magnus, is this something that you can try?  Prune those could of >>> wonky revisions after the delete and before the re-add prior to >>> runn

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Bruce Momjian
Dave Page wrote: > On Tue, Aug 31, 2010 at 4:35 PM, Bruce Momjian wrote: > > Dave Page wrote: > >> On Tue, Aug 31, 2010 at 4:27 PM, Bruce Momjian wrote: > >> > We have already found that exceeding desktop heap might cause a > >> > CreateProcess to return success but later fail with a return code

Re: [HACKERS] Performance Farm Release

2010-08-31 Thread Joshua D. Drake
On Tue, 2010-08-31 at 03:28 -0400, Greg Smith wrote: > 4) Merge the perfarm fork changes into the mainline buildfarm code. I > expect continued bitrot of this code as changes are made to the regular > buildfarm client, so it might be worth considering that sooner rather > than later. As Andre

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 4:35 PM, Bruce Momjian wrote: > Dave Page wrote: >> On Tue, Aug 31, 2010 at 4:27 PM, Bruce Momjian wrote: >> > We have already found that exceeding desktop heap might cause a >> > CreateProcess to return success but later fail with a return code of >> > 128, which causes a

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Cristian Bittel
I am the "remote" support guy for a web developed application (Apache+PHP+Pg. Postgres is isolated on a server, Apache runs on another server), and installed at our client, our client is the Administrator user on Windows Server, I just have a limited privileges Windows user for monitoring. I have m

Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-08-31 Thread Bruce Momjian
Tom Lane wrote: > Greg Smith writes: > > Tom Lane wrote: > >> Well, yes they are. They cause unnecessary process wakeups and thereby > >> consume cycles even when the database is idle. See for example a > >> longstanding complaint here: > >> https://bugzilla.redhat.com/show_bug.cgi?id=252129 >

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Bruce Momjian
Dave Page wrote: > On Tue, Aug 31, 2010 at 4:27 PM, Bruce Momjian wrote: > > Dave Page wrote: > >> On Tue, Aug 31, 2010 at 3:40 PM, Cristian Bittel wrote: > >> > To Dave's question, this behavior occurs on all Windows Server > >> > interactive > >> > sessions, no matter if Administrators or unde

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 4:27 PM, Bruce Momjian wrote: > Dave Page wrote: >> On Tue, Aug 31, 2010 at 3:40 PM, Cristian Bittel wrote: >> > To Dave's question, this behavior occurs on all Windows Server interactive >> > sessions, no matter if Administrators or underpriviledge users, but is >> > rela

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Bruce Momjian
Dave Page wrote: > On Tue, Aug 31, 2010 at 3:40 PM, Cristian Bittel wrote: > > To Dave's question, this behavior occurs on all Windows Server interactive > > sessions, no matter if Administrators or underpriviledge users, but is > > related to closing Windows interactive session while pgAdmin wind

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Tom Lane
Magnus Hagander writes: > On Mon, Aug 30, 2010 at 05:03, Robert Haas wrote: >>> cvs admin -o ? >> >> Magnus, is this something that you can try?  Prune those could of >> wonky revisions after the delete and before the re-add prior to >> running the conversion, and see how that comes out? > Yes,

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 3:40 PM, Cristian Bittel wrote: > To Dave's question, this behavior occurs on all Windows Server interactive > sessions, no matter if Administrators or underpriviledge users, but is > related to closing Windows interactive session while pgAdmin window is > opened and connec

Re: [HACKERS] thousand unrelated data files in pg_default tablespace

2010-08-31 Thread Tom Lane
Pavel Stehule writes: > there is a dump from 8KB files Well, those certainly look like tables/indexes not temp files. So we can rule out one theory. You're *certain* these aren't referenced from pg_class.relfilenode of any of the databases in the server? regards, tom lan

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 3:03 PM, Tom Lane wrote: > Dave Page writes: >> On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane wrote: >>> moa, which is claimed on the buildfarm dashboard to be using gcc but is >>> actually using cc, hits the spinlock problem in 8.0 and 8.1 and the >>> BYTE_ORDER problem in 8

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 2:51 PM, Tom Lane wrote: > Dave Page writes: >>> On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane wrote: Also, although moa is actually green for 8.3, it's showing an initdb failure in 8.4 and up ("cache lookup failed for type 0" while processing system_views.sql)

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Tom Lane
Dave Page writes: > On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane wrote: >> moa, which is claimed on the buildfarm dashboard to be using gcc but is >> actually using cc, hits the spinlock problem in 8.0 and 8.1 and the >> BYTE_ORDER problem in 8.2. > Per above, moa is configured with --disable-spinl

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Tom Lane
Dave Page writes: >> On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane wrote: >>> Also, although moa is actually green for 8.3, it's showing an initdb >>> failure in 8.4 and up ("cache lookup failed for type 0" while processing >>> system_views.sql).  I'm betting this is some sort of >>> over-aggressive-

Re: [HACKERS] [BUGS] BUG #5305: Postgres service stops when closing Windows session

2010-08-31 Thread Dave Page
On Sun, Aug 29, 2010 at 12:05 PM, Magnus Hagander wrote: > On Thu, Aug 26, 2010 at 22:59, Cristian Bittel wrote: >> I still believe this "exit code 128" is related to pgAdmin opened during the >> clossing session on Remote Desktop. I have a Windows user login wich is not >> administrator just no

Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-08-31 Thread Fujii Masao
On Fri, Aug 27, 2010 at 4:39 PM, Fujii Masao wrote: >> /* >>  * XXX: Should we invent an API to wait for data coming from the >>  * client connection too? It's not critical, but we could then >>  * eliminate the timeout altogether and go to sleep for good. >>  */ > > Yes, it would be very helpful

Re: [HACKERS] thousand unrelated data files in pg_default tablespace

2010-08-31 Thread Pavel Stehule
Hello there is a dump from 8KB files Regard Pavel Stehule > > *** > * PostgreSQL File/Block Formatted Dump Utility - Version 8.3.0 > * > * File: /srv/postgresql/data/base/3400014/27059918 > * Options used: None > * > * Dump created

Re: [HACKERS] git: uh-oh

2010-08-31 Thread Magnus Hagander
On Mon, Aug 30, 2010 at 05:03, Robert Haas wrote: > On Wed, Aug 25, 2010 at 2:39 PM, Robert Haas wrote: >> On Wed, Aug 25, 2010 at 1:27 PM, Tom Lane wrote: >>> Robert Haas writes: The fact that the file was "modified" twice after being removed at rev 2.88 seems really wacko.  Are you

Re: [HACKERS] Git conversion progress report and call for testing assistance

2010-08-31 Thread Magnus Hagander
On Sat, Aug 28, 2010 at 16:30, Tom Lane wrote: > Magnus Hagander writes: >> Should we consider actually removing the Log Message header and just >> put the message right at the start? If there's no link first, that >> would be fairly obvious, I think.. > > Either way (header or not) is OK by me.

Re: I: [HACKERS] About "Our CLUSTER implementation is pessimal" patch

2010-08-31 Thread Itagaki Takahiro
Sorry for the very delayed review. On Wed, Jul 21, 2010 at 11:15 PM, Leonardo Francalanci wrote: > 2) what other areas can I comment more? I think the patch is almost ready to commit, but still have some comments for the usability and documentations. I hope native English speakers would help imp

Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-08-31 Thread Fujii Masao
On Tue, Aug 31, 2010 at 4:06 PM, Heikki Linnakangas wrote: > Here's a 2nd version of the "latch" patch. Now with a Windows > implementation. Comments welcome. Seems good. Two minor comments: > rc = WaitForSingleObject(latch->event, timeout / 1000); > if (rc == WAIT_FAILED) > { > ereport(E

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Dave Page
On Tue, Aug 31, 2010 at 10:28 AM, Dave Page wrote: > On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane wrote: >> Also, although moa is actually green for 8.3, it's showing an initdb >> failure in 8.4 and up ("cache lookup failed for type 0" while processing >> system_views.sql).  I'm betting this is some

Re: [HACKERS] huia and moa versus old PG branches

2010-08-31 Thread Dave Page
On Mon, Aug 30, 2010 at 3:50 AM, Tom Lane wrote: > The new buildfarm machines huia and moa aren't doing terribly well > with the older PG branches.  This isn't really those machines' fault; > what I find after a bit of digging is that we just didn't have good > support for 64-bit Solaris until rel

[HACKERS] Estimation of Plan quality

2010-08-31 Thread vamsi krishna
Dear all Can someone tell me how to estimate the quality of my plan. For example if the ideal query plan generated by Dynamic Programming has a plan quality of 1.0, and suppose I generate my query plan with some greedy method or something, it will be worse (not as optimal as) than ideal plan by,

Re: [HACKERS] Performance Farm Release

2010-08-31 Thread Greg Smith
Stephen Frost wrote: You can certainly run it yourself locally w/o setting it up to report back to the build or performance farm.. So, yes, you can, you'll just have to look through the outputs yourself and it won't necessairly make much sense unless you've been doing those runs for a period of

Re: [HACKERS] How to construct an exact plan

2010-08-31 Thread PostgreSQL - Hans-Jürgen Schönig
hello ... here is the ultimate revelation of planner hints in postgres ... let us praise oleg and teodor for solving a practical problem for practical people ... http://www.sai.msu.su/~megera/wiki/plantuner try this one ... it is excellent and definitely helpful for many many people out there.

Re: Interruptible sleeps (was Re: [HACKERS] CommitFest 2009-07: Yay, Kevin! Thanks, reviewers!)

2010-08-31 Thread Heikki Linnakangas
Here's a 2nd version of the "latch" patch. Now with a Windows implementation. Comments welcome. -- Heikki Linnakangas EnterpriseDB http://www.enterprisedb.com diff --git a/configure b/configure index bd9b347..432cd58 100755 --- a/configure +++ b/configure @@ -27773,6 +27773,13 @@ _ACEOF