Re: [GENERAL] SSDs with Postgresql?

2011-04-13 Thread John R Pierce
On 04/13/11 9:19 PM, Benjamin Smith wrote: The speed benefits of SSDs as benchmarked would seem incredible. Can anybody comment on SSD benefits and problems in real life use? I maintain some 100 databases on 3 servers, with 32 GB of RAM each and an extremely rich, complex schema. (300+ norm

[GENERAL] PostgreSQL trap, and assertion failed

2011-04-13 Thread Radosław Smogura
Hello, I have small crash reporting code, which I use during mmap-ing database. After last merge with master I got TRAP: FailedAssertion("!(slot > 0 && slot <= PMSignalState->num_child_flags)", File: "pmsignal.c", Line: 227) LOG: server process (PID 5128) was terminated by signal 6: Aborted L

Re: [GENERAL] updating rows which have a common value forconsecutive dates

2011-04-13 Thread David Johnston
You need to turn the query with the window function into a sub-query and then in the outer query you can refer to the inner-query's rank() column. The inner query should effectively get you the last two test results for each context and then you can check to see if any of those failed. I have

Re: [GENERAL] updating rows which have a common value forconsecutive dates

2011-04-13 Thread Lonni J Friedman
Hi David, Thanks for your reply. I'm using 8.4.7, so window functions are certainly an option, although I've admittedly never used them before. I've spent the past few hours reading the dox, and I now have a rudimentary understanding of window functions. I tried to compose a query based on your s

[GENERAL] SSDs with Postgresql?

2011-04-13 Thread Benjamin Smith
The speed benefits of SSDs as benchmarked would seem incredible. Can anybody comment on SSD benefits and problems in real life use? I maintain some 100 databases on 3 servers, with 32 GB of RAM each and an extremely rich, complex schema. (300+ normalized tables) I was wondering if anybody her

Re: [GENERAL] 9.0 Out of memory

2011-04-13 Thread Tom Lane
Jeremy Palmer writes: > Ok I removed the geometry column from the cursor query within the function > and the session still runs out of memory. I'm still seeing the same error > message as well: > PortalHeapMemory: 16384 total in 4 blocks; 5944 free (0 chunks); 10440 > used > Executor

Re: [GENERAL] 9.0 Out of memory

2011-04-13 Thread Jeremy Palmer
> No, given the info from the memory map I'd have to say that the leakage > is in the cursor not in what you do in the plpgsql function. The cursor > query looks fairly unexciting except for the cast from geometry to text. > I don't have PostGIS installed here so I can't do any testing, but I > wo

Re: [GENERAL] Postgres 8.3 erro on shared memory windows

2011-04-13 Thread Craig Ringer
On 13/04/2011 8:02 PM, paulo matadr wrote: Hi All, Anyone knowns how to start postgres on win 2003 r2 with 2 GB of shared memory on O.S with 8GB. You can't on Windows, unless you're running a 64-bit build on a 64-bit OS. Given that Pg on Windows doesn't perform as well with lots of shared me

Re: [GENERAL] Memory management in Postgres

2011-04-13 Thread Jorge Arévalo
2011/4/13 Simon Riggs : > 2011/4/13 Jorge Arévalo : >> >> I'm very interested in PostgreSQL memory management, specially in the >> concept "memory context". I've read the official documentation at >> http://www.postgresql.org/docs/8.4/static/spi-memory.html, but I'd >> like to learn more about it.

Re: [GENERAL] Replication: slave is in permanent startup 'recovery'

2011-04-13 Thread Tomas Vondra
Dne 13.4.2011 20:42, Henry C. napsal(a): > > Forgot to mention recovery.conf on slave: > > standby_mode = 'on' > primary_conninfo = 'host..." > restore_command = 'cp /home/psql-wal-archive/%f "%p"' > archive_cleanup_command = 'pg_archivecleanup /home/psql-wal-archive %r' > > > The wiki states "

Re: [GENERAL] Memory management in Postgres

2011-04-13 Thread Simon Riggs
2011/4/13 Jorge Arévalo : > > I'm very interested in PostgreSQL memory management, specially in the > concept "memory context". I've read the official documentation at > http://www.postgresql.org/docs/8.4/static/spi-memory.html, but I'd > like to learn more about it. Do you recommend me any particu

Re: [GENERAL] Memory leak in SPI_finish call

2011-04-13 Thread Jorge Arévalo
2011/4/5 Jorge Arévalo : > Hello, > > I'm having problems with a PostgreSQL server side C-function. It's not > an aggregate function (operates over a only row of data). When the > function is called over tables with ~4000 rows, it causes postgres > backend crash with SEGFAULT. I know the error is a

[GENERAL] Memory management in Postgres

2011-04-13 Thread Jorge Arévalo
Hello, I'm very interested in PostgreSQL memory management, specially in the concept "memory context". I've read the official documentation at http://www.postgresql.org/docs/8.4/static/spi-memory.html, but I'd like to learn more about it. Do you recommend me any particular book or url? Many thank

Re: [GENERAL] [ADMIN] Streaming Replication limitations

2011-04-13 Thread Tom Lane
Simon Riggs writes: > 2011/4/13 Tom Lane : >> Short answer is to test the case you have in mind and see. > That's the long answer, not least because the absence of a failure in > a test is not conclusive proof that it won't fail at some point in the > future while in production. Not really. Eve

Re: [GENERAL] Replication: slave is in permanent startup 'recovery'

2011-04-13 Thread Henry C.
Forgot to mention recovery.conf on slave: standby_mode = 'on' primary_conninfo = 'host..." restore_command = 'cp /home/psql-wal-archive/%f "%p"' archive_cleanup_command = 'pg_archivecleanup /home/psql-wal-archive %r' The wiki states "If wal_keep_segments is a high enough number to retain the WA

Re: [GENERAL] [ADMIN] Streaming Replication limitations

2011-04-13 Thread Simon Riggs
2011/4/13 Tom Lane : > Devrim =?ISO-8859-1?Q?G=DCND=DCZ?= writes: >> On Wed, 2011-04-13 at 23:23 +0530, raghu ram wrote: >>> Is there any limitations to configure streaming replication between >>> different operating systems i.e solaris 64 bit to RHEL 64 bit. > >> It won't work. > > As long as it'

Re: [GENERAL] [ADMIN] Streaming Replication limitations

2011-04-13 Thread AShved
since your onine logs are in different endian notation. I do not see how it would work. Sony may be an option in this case. Andrew Shved From: Tom Lane To: Devrim GÜNDÜZ Cc: raghu ram , pgsql-ad...@postgresql.org, pgsql-general@postgresql.org Date: 04/13/2011 02:14 PM Subject: Re: [ADMIN]

Re: [GENERAL] [ADMIN] Streaming Replication limitations

2011-04-13 Thread AShved
just hit me what if we use pg_standby and convert archive logs from one notation to the other. and after apply them to our standby. can this work? Andrew Shved DBA, Symcor Inc, Delivery Support Services ( Phone: 905-273-1433 ( BlackBerry: 416-803-2675 * Email: ash...@symcor.com From: Tom La

[GENERAL] Replication: slave is in permanent startup 'recovery'

2011-04-13 Thread Henry C.
Greets, Pg 9.0.3 This must be due to my own misconfiguration, so apologies if I'm not seeing the obvious - I've noticed that my slave seems to be stuck in a permanent startup/recovery state. ps on the slave shows: ... postgres: wal receiver process streaming 190/A6C384A0 postgres: startup pro

Re: [GENERAL] 9.0 Out of memory

2011-04-13 Thread Tom Lane
Jeremy Palmer writes: > The plpgsql code that is could be to blame is in the below snippet. I had a > look and I'm not sure why it might be leaking. Is it because I assign the > v_id1 and v_id2 to the return table 'id' record, return it and then assign to > v_id1 or v_id2 again from the cursor?

Re: [GENERAL] [ADMIN] Streaming Replication limitations

2011-04-13 Thread Tom Lane
Devrim =?ISO-8859-1?Q?G=DCND=DCZ?= writes: > On Wed, 2011-04-13 at 23:23 +0530, raghu ram wrote: >> Is there any limitations to configure streaming replication between >> different operating systems i.e solaris 64 bit to RHEL 64 bit. > It won't work. As long as it's the same machine architectur

Re: [GENERAL] Streaming Replication limitations

2011-04-13 Thread Andrew Sullivan
On Wed, Apr 13, 2011 at 11:23:24PM +0530, raghu ram wrote: > Hi, > > Is there any limitations to configure streaming replication between > different operating systems i.e solaris 64 bit to RHEL 64 bit. I personally wouldn't be willing to use anything except identical binaries for the back end, an

Re: [GENERAL] [ADMIN] Streaming Replication limitations

2011-04-13 Thread Devrim GÜNDÜZ
Hi, On Wed, 2011-04-13 at 23:23 +0530, raghu ram wrote: > Is there any limitations to configure streaming replication between > different operating systems i.e solaris 64 bit to RHEL 64 bit. It won't work. Regards, -- Devrim GÜNDÜZ Principal Systems Engineer @ EnterpriseDB: http://www.enter

[GENERAL] Streaming Replication limitations

2011-04-13 Thread raghu ram
Hi, Is there any limitations to configure streaming replication between different operating systems i.e solaris 64 bit to RHEL 64 bit. --Raghu Ram

Re: [GENERAL] Weird WAL problem - 9.0.3

2011-04-13 Thread Tom Lane
Rafael Martinez writes: > But this doesn't explain the WAL files not been created/recycled > time-ordered. I wonder if this happened because the partition got full > while the WALs were created/recycled? When a checkpoint finishes, it scans the pg_xlog directory to find WAL files that are no long

Re: [GENERAL] updating rows which have a common value forconsecutive dates

2011-04-13 Thread David Johnston
If you have the ability to use Window functions you can group (as necessary), order by last_update, and then use rank() to number each test run sequentially. Then you can limit the results to ( rank() <= 2 AND current_status = 'FAILED' ). David J. -Original Message- From: pgsql-gener

Re: [GENERAL] Cursor metadata

2011-04-13 Thread Tom Lane
"Andy Chambers" writes: > Is there anywhere in the postgres catalog where one can access metadata > about a held cursor. The pg_cursors system view offers some info ... > Type information > in particular would be really useful. ... but not that. Usually the best way to get information about

Re: [GENERAL] Adding a default value to a column after it exists

2011-04-13 Thread Andrew Sullivan
On Wed, Apr 13, 2011 at 09:21:20AM -0700, Gauthier, Dave wrote: > Is there a way to add a default value definition to an existing column? > Something like an "alter table... alter column... default 'foo'". ALTER TABLE table ALTER [ COLUMN ] column SET DEFAULT expression (see http://www.postgres

Re: [GENERAL] Adding a default value to a column after it exists

2011-04-13 Thread Tom Lane
"Gauthier, Dave" writes: > Is there a way to add a default value definition to an existing column? > Something like an "alter table... alter column... default 'foo'". ALTER TABLE ... ALTER COLUMN ... SET DEFAULT ... regards, tom lane -- Sent via pgsql-general mailing

Re: [GENERAL] Adding a default value to a column after it exists

2011-04-13 Thread Mike Fowler
Hi Dave, On 13/04/11 17:21, Gauthier, Dave wrote: Is there a way to add a default value definition to an existing column? Something like an "alter table... alter column... default 'foo'". Sure is something like that: ALTER TABLE tablename ALTER COLUMN columnname SET DEFAULT expression;

[GENERAL] Adding a default value to a column after it exists

2011-04-13 Thread Gauthier, Dave
Is there a way to add a default value definition to an existing column? Something like an "alter table... alter column... default 'foo'". I thought of a clumsy way to do this... create a temp column, set it's value to that of the column to be altered, drop the column to be altered, redefine it

[GENERAL] Cursor metadata

2011-04-13 Thread Andy Chambers
Hi All, Is there anywhere in the postgres catalog where one can access metadata about a held cursor. Type information in particular would be really useful. Cheers, Andy -- Andy Chambers -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscripti

Re: [GENERAL] Weird WAL problem - 9.0.3

2011-04-13 Thread Rafael Martinez
On Wed, 2011-04-13 at 06:28 -0700, Adrian Klaver wrote: > On Wednesday, April 13, 2011 6:09:25 am Rafael Martinez wrote: > > Might want to take a look at: > [..] > sequence). If, due to a short-term peak of log output rate, there are > more than 3 * checkpoint_segments + 1 segment files, th

Re: [BUGS] [GENERAL] PostgreSQL backend process high memory usage issue

2011-04-13 Thread Merlin Moncure
On Wed, Apr 13, 2011 at 12:29 AM, Tom Lane wrote: > Merlin Moncure writes: >> I think you may have uncovered a leak (I stand corrected). > >> The number of schemas in your test is irrelevant -- the leak is >> happening in proportion to the number of views (set via \setrandom >> tidx 1 10).  At 1

Re: [GENERAL] Weird WAL problem - 9.0.3

2011-04-13 Thread Adrian Klaver
On Wednesday, April 13, 2011 6:09:25 am Rafael Martinez wrote: > Hello > > Yesterday we had a weird problem with the pg_xlog partition in one of > our servers: > > - The amount of WAL files was much higher than (2*checkpoint_segments)+1 > (over 360 WAL files) > Might want to take a look at: htt

[GENERAL] Weird WAL problem - 9.0.3

2011-04-13 Thread Rafael Martinez
Hello Yesterday we had a weird problem with the pg_xlog partition in one of our servers: - The amount of WAL files was much higher than (2*checkpoint_segments)+1 (over 360 WAL files) - The WAL files were not created/recycle time-ordered. Here is an example: . 16777216 Apr 12

[GENERAL] Postgres 8.3 erro on shared memory windows

2011-04-13 Thread paulo matadr
Hi All, Anyone knowns how to start postgres on win 2003 r2 with 2 GB of shared memory on O.S with 8GB. ERROR FATAL: could not create shared memory segment 5 Failed system call was MapViewOFFileEx I try use PAE : /PAE /3GB but not sucessed. Regards Paulo

Re: [GENERAL] Speeding up replication startup/recovery

2011-04-13 Thread Henry C.
On Wed, April 13, 2011 11:16, Simon Riggs wrote: >> seems to be chugging along at a rather sedate pace. > > The replication lag is zero since the master and slave WAL locations match. > > > There seems to be nothing to expedite... why do you say it is slow? > > > Maybe because you see this as an "i

Re: [GENERAL] Speeding up replication startup/recovery

2011-04-13 Thread Simon Riggs
On Wed, Apr 13, 2011 at 10:03 AM, Henry C. wrote: > My test replication seems to be proceeding normally, but the process appears > to be quite slow: > > SLAVE > ...postgres: startup process   recovering 000101900024    (1) > ...postgres: wal receiver process   streaming 190/244FEA80 >

[GENERAL] Speeding up replication startup/recovery

2011-04-13 Thread Henry C.
Greets, My test replication seems to be proceeding normally, but the process appears to be quite slow: SLAVE ...postgres: startup process recovering 000101900024(1) ...postgres: wal receiver process streaming 190/244FEA80 MASTER ...postgres: wal sender process replicator 1.1.

Re: [GENERAL] Blob handling with Delphi...

2011-04-13 Thread John R Pierce
On 04/13/11 1:28 AM, Durumdara wrote: Hi! PG9.0, Delphi 6, Zeos. I want to use PGSQL bytea field as normal BLOB field in Delphi. But when I insert a value into this field, for example all characters (chr 0..255), and I fetch, and save it as blob stream into a file, I got interesting result,

[GENERAL] Blob handling with Delphi...

2011-04-13 Thread Durumdara
Hi! PG9.0, Delphi 6, Zeos. I want to use PGSQL bytea field as normal BLOB field in Delphi. But when I insert a value into this field, for example all characters (chr 0..255), and I fetch, and save it as blob stream into a file, I got interesting result, not what I stored here previously. It is

Re: [GENERAL] Trying out replication: cp cannot stat log file during recovery

2011-04-13 Thread Henry C.
On Wed, April 13, 2011 04:28, Fujii Masao wrote: > When the standby fails to read the WAL file from the archive, it tries to > read that from the master via replication connection. So the standby would not > skip that file. Great, thanks. It looks like it's proceeding normally (if slow) then. -

[GENERAL] updating rows which have a common value forconsecutive dates

2011-04-13 Thread Lonni J Friedman
Greetings, I have a table full of automated test data, which continuously has new unique data inserted: Column |Type | Modifiers +-+- id | integer

Re: [GENERAL] 9.0 Out of memory

2011-04-13 Thread Jeremy Palmer
Hi Tom, Wow thank you so much for the hint! The plpgsql code that is could be to blame is in the below snippet. I had a look and I'm not sure why it might be leaking. Is it because I assign the v_id1 and v_id2 to the return table 'id' record, return it and then assign to v_id1 or v_id2 again f

Re: [GENERAL] Postgres 9.0 + LDAP

2011-04-13 Thread Sim Zacks
On 04/13/2011 03:36 AM, Vinzenz Bildstein wrote: Right now the line I would add to the pg_hba.conf would look something like this: host database all CIDR ldap ldapserver=my.domain.com ldapbasedn="dc=my,dc=domain,dc=com" ldapprefix="cn=ldap,cn=users" ldapsuffix="dc=my,dc=domain,dc=com" You ne