Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Takayuki Tsunakawa
From: Inaam Rana > Which IO Shceduler (elevator) you are using? Elevator? Sorry, I'm not familiar with the kernel implementation, so I don't what it is. My Linux distribution is Red Hat Enterprise Linux 4.0 for AMD64/EM64T, and the kernel is 2.6.9-42.ELsmp. I probably havn't changed any kernel

[HACKERS] configure problem --with-libxml

2006-12-22 Thread Pavel Stehule
Hello, I try to compile postgres with SQL/XML, but I finished on checking libxml/parser.h usability... no checking libxml/parser.h presence... no checking for libxml/parser.h... no configure: error: header file is required for XML support I have Fedora Core 6, and libxml2-devel I have installe

Re: [HACKERS] configure problem --with-libxml

2006-12-22 Thread Stefan Kaltenbrunner
Pavel Stehule wrote: Hello, I try to compile postgres with SQL/XML, but I finished on checking libxml/parser.h usability... no checking libxml/parser.h presence... no checking for libxml/parser.h... no configure: error: header file is required for XML support I have Fedora Core 6, and libxml2

[HACKERS] xmlagg is not supported?

2006-12-22 Thread Pavel Stehule
Hello, why xmlagg is missing in SQL/XML support? Regards Pavel Stehule _ Citite se osamele? Poznejte nekoho vyjmecneho diky Match.com. http://www.msn.cz/ ---(end of broadcast)---

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread ITAGAKI Takahiro
"Takayuki Tsunakawa" <[EMAIL PROTECTED]> wrote: > (1) Default case(this is show again for comparison and reminder) > 235 80 226 77 240 > (2) Default + WAL 1MB case > 302 328 82 330 85 > (3) Default + wal_sync_method=open_sync case > 162 67 176 67 164 > (4) (2)+(3) case > 322 350 85

Re: [HACKERS] configure problem --with-libxml

2006-12-22 Thread Pavel Stehule
I solved it via symlink, but this is much cleaner Maybe configure scripts needs little bit more inteligence. All people on RH systems have to do it :-( Thank you Pavel Stehule From: Stefan Kaltenbrunner <[EMAIL PROTECTED]> To: Pavel Stehule <[EMAIL PROTECTED]> CC: pgsql-hackers@postgresql.

Re: column ordering, was Re: [HACKERS] [PATCHES] Enums patch v2

2006-12-22 Thread Zeugswetter Andreas ADI SD
> >> You could make a case that we need *three* numbers: a permanent column > >> ID, a display position, and a storage position. > > > Could this not be handled by some catalog fixup after an add/drop? If we > > get the having 3 numbers you will almost have me convinced that this > > might be t

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Takayuki Tsunakawa
From: "Greg Smith" <[EMAIL PROTECTED]> > This is actually a question I'd been meaning to throw out myself to this > list. How hard would it be to add an internal counter to the buffer > management scheme that kept track of the current number of dirty pages? > I've been looking at the bufmgr code l

Re: [HACKERS] configure problem --with-libxml

2006-12-22 Thread Nikolay Samokhvalov
another way is: export CPPFLAGS=$(xml2-config --cflags); ./configure --with-libxml I think that such thing can be used in configure script itself, overwise a lot of people will try, fail and do not use SQL/XML at all. On 12/22/06, Pavel Stehule <[EMAIL PROTECTED]> wrote: Hello, I try to compil

Re: [HACKERS] xmlagg is not supported?

2006-12-22 Thread Nikolay Samokhvalov
Hmm... In my patch (http://chernowiki.ru/index.php?node=98) I didn't remove this, moreover I've fixed a couple of issues... Looks like it was removed by Peter (both patches he mailed lack it). Actually, without this function a set is SQL/XML publishing functions becomes rather poor. Peter? On

Re: [HACKERS] xmlagg is not supported?

2006-12-22 Thread Nikolay Samokhvalov
Another thing that was removed is XMLCOMMENT.. On 12/22/06, Nikolay Samokhvalov <[EMAIL PROTECTED]> wrote: Hmm... In my patch (http://chernowiki.ru/index.php?node=98) I didn't remove this, moreover I've fixed a couple of issues... Looks like it was removed by Peter (both patches he mailed lack

Re: [HACKERS] New version of money type

2006-12-22 Thread D'Arcy J.M. Cain
On Thu, 21 Dec 2006 10:47:52 -0500 Tom Lane <[EMAIL PROTECTED]> wrote: > One bug I see in it is that you'd better make the alignment 'd' if the > type is to be int8. Also I much dislike these changes: > > - int32 i = PG_GETARG_INT32(1); > + int64 i = PG_GETARG_INT32(1)

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Takayuki Tsunakawa
> (3) is very strange. Your machine seems to be too restricted > by WAL so that other factors cannot be measured properly. Right... It takes as long as 15 seconds to fsync 1GB file. It's strange. This is a borrowed PC server, so the disk may be RAID 5? However, the WAL disk and DB disks show th

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Zeugswetter Andreas ADI SD
> > If you use linux, try the following settings: > > 1. Decrease /proc/sys/vm/dirty_ratio and dirty_background_ratio. You will need to pair this with bgwriter_* settings, else too few pages are written to the os inbetween checkpoints. > > 2. Increase wal_buffers to redule WAL flushing. You

Re: [HACKERS] configure problem --with-libxml

2006-12-22 Thread Peter Eisentraut
Nikolay Samokhvalov wrote: > another way is: > export CPPFLAGS=$(xml2-config --cflags); ./configure --with-libxml > > I think that such thing can be used in configure script itself, > overwise a lot of people will try, fail and do not use SQL/XML at > all. The reason why I did not do this was that

Re: [HACKERS] xmlagg is not supported?

2006-12-22 Thread Peter Eisentraut
Nikolay Samokhvalov wrote: > Another thing that was removed is XMLCOMMENT.. XMLCOMMENT works. -- Peter Eisentraut http://developer.postgresql.org/~petere/ ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings

Re: [HACKERS] xmlagg is not supported?

2006-12-22 Thread Peter Eisentraut
Pavel Stehule wrote: > why xmlagg is missing in SQL/XML support? Because the version contained in the patch did not work properly. It should be added back, of course. -- Peter Eisentraut http://developer.postgresql.org/~petere/ ---(end of broadcast)

Re: [HACKERS] configure problem --with-libxml

2006-12-22 Thread Martijn van Oosterhout
On Fri, Dec 22, 2006 at 03:03:49PM +0100, Peter Eisentraut wrote: > Nikolay Samokhvalov wrote: > > another way is: > > export CPPFLAGS=$(xml2-config --cflags); ./configure --with-libxml > > > > I think that such thing can be used in configure script itself, > > overwise a lot of people will try, fa

Re: [HACKERS] Companies Contributing to Open Source

2006-12-22 Thread Simon Riggs
On Wed, 2006-12-20 at 00:29 -0800, David Fetter wrote: > On Tue, Dec 19, 2006 at 05:40:12PM -0500, Bruce Momjian wrote: > > Lukas Kahwe Smith wrote: > > > I think another point you need to bring out more clearily is that > > > the community is also often "miffed" if they feel they have been > > > l

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Simon Riggs
On Thu, 2006-12-21 at 18:46 +0900, ITAGAKI Takahiro wrote: > "Takayuki Tsunakawa" <[EMAIL PROTECTED]> wrote: > > > > If you use Linux, it has very unpleased behavior in fsync(); It locks all > > > metadata of the file being fsync-ed. We have to wait for the completion of > > > fsync when we do rea

Re: [HACKERS] configure problem --with-libxml

2006-12-22 Thread Tom Lane
Martijn van Oosterhout writes: > On Fri, Dec 22, 2006 at 03:03:49PM +0100, Peter Eisentraut wrote: >> The reason why I did not do this was that this could resolve >> to -I/usr/include or -I/usr/local/include, but adding such a standard >> path explicitly is wrong on some systems. > But if people

Re: [HACKERS] Operator class group proposal

2006-12-22 Thread Gregory Stark
"Tom Lane" <[EMAIL PROTECTED]> writes: > A class group is associated with a specific index AM and can contain only > opclasses for that AM. We might for instance invent "numeric" and > "numeric_reverse" groups for btree, to contain the default opclasses and > reverse-sort opclasses for the stand

[HACKERS] recent --with-libxml support

2006-12-22 Thread Jeremy Drake
I adjusted my buildfarm config (mongoose) to attempt to build HEAD --with-libxml. I added the following to build-farm.conf: if ($branch eq 'HEAD' || $branch ge 'REL8_3') { push(@{$conf{config_opts}}, "--with-includes=/usr/include/et:/usr/include/libxml2"); push(@{$conf{config_opts}}, "-

Re: [HACKERS] Companies Contributing to Open Source

2006-12-22 Thread Bruce Momjian
Guido Barosio wrote: > > "Companies often bring fresh prespective, ideas, and testing > infrastucture to a project." > > > "prespective" || "perspective" ? Thanks, fixed. --- > > g.- > > > On 12/21/06, Kevin Grittner

Re: [HACKERS] Operator class group proposal

2006-12-22 Thread Tom Lane
Gregory Stark <[EMAIL PROTECTED]> writes: > I thought that would just be formalizing what we currently have. But I just > discovered to my surprise tat it's not. I don't see any cross-data-type > operators between any of the integer types and numeric, or between any of the > floating point types an

Re: [HACKERS] recent --with-libxml support

2006-12-22 Thread Tom Lane
Jeremy Drake <[EMAIL PROTECTED]> writes: > As seen, I needed to add an include dir for configure to pass. However, > make check fails now with the backend crashing. This can be seen in the > buildfarm results for mongoose. Can you provide a stack trace for that crash? re

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Bruce Momjian
I have a new idea. Rather than increasing write activity as we approach checkpoint, I think there is an easier solution. I am very familiar with the BSD kernel, and it seems they have a similar issue in trying to smooth writes: http://www.brno.cas.cz/cgi-bin/bsdi-man?proto=1.1&

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Inaam Rana
On 12/22/06, Takayuki Tsunakawa <[EMAIL PROTECTED]> wrote: From: Inaam Rana > Which IO Shceduler (elevator) you are using? Elevator? Sorry, I'm not familiar with the kernel implementation, so I don't what it is. My Linux distribution is Red Hat Enterprise Linux 4.0for AMD64/EM64T, and the k

Re: [HACKERS] recent --with-libxml support

2006-12-22 Thread Jeremy Drake
On Fri, 22 Dec 2006, Tom Lane wrote: > Jeremy Drake <[EMAIL PROTECTED]> writes: > > As seen, I needed to add an include dir for configure to pass. However, > > make check fails now with the backend crashing. This can be seen in the > > buildfarm results for mongoose. > > Can you provide a stack

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Gregory Stark
"Bruce Momjian" <[EMAIL PROTECTED]> writes: > I have a new idea. Rather than increasing write activity as we approach > checkpoint, I think there is an easier solution. I am very familiar > with the BSD kernel, and it seems they have a similar issue in trying to > smooth writes: Just to give a

Re: [HACKERS] Operator class group proposal

2006-12-22 Thread Gregory Stark
Tom Lane <[EMAIL PROTECTED]> writes: > No, what you'll get is something like > > int4var::float8 float8eq float8var > > which is perfectly mergejoinable ... however, it's not clear that the > planner will make very good estimates about the value of the cast > expression. I'm not sure if

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Greg Smith
On Fri, 22 Dec 2006, Simon Riggs wrote: I have also seen cases where the WAL drive, even when separated, appears to spike upwards during a checkpoint. My best current theory, so far untested, is that the WAL and data drives are using the same CFQ scheduler and that the scheduler actively slows d

Re: [HACKERS] Companies Contributing to Open Source

2006-12-22 Thread Gregory Stark
"Simon Riggs" <[EMAIL PROTECTED]> writes: > In a humble, non-confrontational tone: Why/How does a patch imply a fait > accompli, or show any disrespect? Well depending on the circumstances it could show the poster isn't interested in the judgement of the existing code authors. It can be hard to

Re: [HACKERS] Load distributed checkpoint

2006-12-22 Thread Bruce Momjian
Gregory Stark wrote: > > "Bruce Momjian" <[EMAIL PROTECTED]> writes: > > > I have a new idea. Rather than increasing write activity as we approach > > checkpoint, I think there is an easier solution. I am very familiar > > with the BSD kernel, and it seems they have a similar issue in trying to

Re: [HACKERS] Companies Contributing to Open Source

2006-12-22 Thread Bruce Momjian
OK, based on this feedback and others, I have made a new version of the article: http://momjian.us/main/writings/pgsql/company_contributions/ There are no new concepts, just a more balance article with some of the awkward wording improved. I also added a link to the article from the dev

Re: [HACKERS] Companies Contributing to Open Source

2006-12-22 Thread Bruce Momjian
Kevin Grittner wrote: > >>> On Tue, Dec 19, 2006 at 6:13 PM, in message > <[EMAIL PROTECTED]>, Bruce Momjian > <[EMAIL PROTECTED]> wrote: > > if the company dies, the community keeps going (as it did after > Great > > Bridge, without a hickup), but if the community dies, the company > dies > > too

[HACKERS] Strange pgsql crash on MacOSX

2006-12-22 Thread Shane Ambler
I have a dual G4 1.25Ghz with 2GB RAM running Mac OSX 10.4.8 and PostgreSQL 8.2.0 This only happened to me today and with everything I have tried it always happens now - had been running fine before. The only thing I can think of that has changed in the last few days is I have installed the la

Re: [HACKERS] Operator class group proposal

2006-12-22 Thread Tom Lane
Gregory Stark <[EMAIL PROTECTED]> writes: > So the only reason we needed the cross-data-type operators was to get better > estimates? I thought without them you couldn't get an index-based plan at all. Oh, hm, there is that --- you won't get a nestloop with inner indexscan unless the join expressi

Re: [HACKERS] Strange pgsql crash on MacOSX

2006-12-22 Thread Tom Lane
Shane Ambler <[EMAIL PROTECTED]> writes: > postgres=# \q > psql(24931) malloc: *** error for object 0x180a800: incorrect checksum > for freed object - object was probably modified after being freed, break > at szone_error to debug > psql(24931) malloc: *** set a breakpoint in szone_error to debug >

Re: [HACKERS] recent --with-libxml support

2006-12-22 Thread Tom Lane
Jeremy Drake <[EMAIL PROTECTED]> writes: >> Can you provide a stack trace for that crash? > #0 0xb7c4dc85 in memcpy () from /lib/tls/libc.so.6 > #1 0x08190f59 in appendBinaryStringInfo (str=0xbfd87f90, > data=0x841ffc0 "qux", datalen=138543040) at stringinfo.c:192 > #2 0x0828377f in map_sql

Re: [HACKERS] Interface for pg_autovacuum

2006-12-22 Thread Robert Treat
On Thursday 21 December 2006 10:57, Dave Page wrote: > Simon Riggs wrote: > > On Wed, 2006-12-20 at 09:47 -0500, Jim Nasby wrote: > >> On the other hand, this would be the only part of the system where > >> the official interface/API is a system catalog table. Do we really > >> want to expose the i

Re: [HACKERS] recent --with-libxml support

2006-12-22 Thread Jeremy Drake
On Fri, 22 Dec 2006, Tom Lane wrote: > Jeremy Drake <[EMAIL PROTECTED]> writes: > >> Can you provide a stack trace for that crash? > > > #0 0xb7c4dc85 in memcpy () from /lib/tls/libc.so.6 > > #1 0x08190f59 in appendBinaryStringInfo (str=0xbfd87f90, > > data=0x841ffc0 "qux", datalen=138543040

Re: [HACKERS] recent --with-libxml support

2006-12-22 Thread Peter Eisentraut
Jeremy Drake wrote: > #0 0xb7c4dc85 in memcpy () from /lib/tls/libc.so.6 > #1 0x08190f59 in appendBinaryStringInfo (str=0xbfd87f90, > data=0x841ffc0 "qux", datalen=138543040) at stringinfo.c:192 > #2 0x0828377f in map_sql_identifier_to_xml_name (ident=0x841ffc0 > "qux", fully_escaped=0 '\0')

Re: [HACKERS] recent --with-libxml support

2006-12-22 Thread Tom Lane
Peter Eisentraut <[EMAIL PROTECTED]> writes: > Jeremy Drake wrote: >> #0 0xb7c4dc85 in memcpy () from /lib/tls/libc.so.6 >> #1 0x08190f59 in appendBinaryStringInfo (str=0xbfd87f90, >> data=0x841ffc0 "qux", datalen=138543040) at stringinfo.c:192 >> #2 0x0828377f in map_sql_identifier_to_xml_name

Re: [HACKERS] recent --with-libxml support

2006-12-22 Thread Jeremy Drake
On Sat, 23 Dec 2006, Tom Lane wrote: > Peter Eisentraut <[EMAIL PROTECTED]> writes: > > Jeremy Drake wrote: > >> #0 0xb7c4dc85 in memcpy () from /lib/tls/libc.so.6 > >> #1 0x08190f59 in appendBinaryStringInfo (str=0xbfd87f90, > >> data=0x841ffc0 "qux", datalen=138543040) at stringinfo.c:192 > >>

Re: [HACKERS] recent --with-libxml support

2006-12-22 Thread Jeremy Drake
On Fri, 22 Dec 2006, Jeremy Drake wrote: > On Sat, 23 Dec 2006, Tom Lane wrote: > > > Peter Eisentraut <[EMAIL PROTECTED]> writes: > > > Jeremy Drake wrote: > > >> #0 0xb7c4dc85 in memcpy () from /lib/tls/libc.so.6 > > >> #1 0x08190f59 in appendBinaryStringInfo (str=0xbfd87f90, > > >> data=0x841