Re: [GENERAL] vacuumdb --analyze-only scans all pages?

2016-12-29 Thread Gerhard Wiesinger
On 29.12.2016 16:10, Tom Lane wrote: Adrian Klaver writes: On 12/28/2016 11:54 PM, Gerhard Wiesinger wrote: vacuumdb --analyze-only --all --verbose INFO: analyzing "public.log" INFO: "log": scanned 3 of 30851 pages, containing 3599899 live rows and 0 dead rows; 3 rows in sample, 3702

Re: [GENERAL] vacuumdb --analyze-only scans all pages?

2016-12-29 Thread Tom Lane
Adrian Klaver writes: > On 12/28/2016 11:54 PM, Gerhard Wiesinger wrote: >> vacuumdb --analyze-only --all --verbose >> INFO: analyzing "public.log" >> INFO: "log": scanned 3 of 30851 pages, containing 3599899 live rows >> and 0 dead rows; 3 rows in sample, 3702016 estimated total rows >>

Re: [GENERAL] vacuumdb --analyze-only scans all pages?

2016-12-29 Thread Adrian Klaver
On 12/28/2016 11:54 PM, Gerhard Wiesinger wrote: Hello, PostgreSQl 9.6.1: after a pg_dump/restore procedure it scans all pages (at least for some of the tables, analyze-only switch is specified). I would expect that only the sample rows are scanned. "log_details": scanned 2133350 of 2133350 p

[GENERAL] vacuumdb --analyze-only scans all pages?

2016-12-28 Thread Gerhard Wiesinger
Hello, PostgreSQl 9.6.1: after a pg_dump/restore procedure it scans all pages (at least for some of the tables, analyze-only switch is specified). I would expect that only the sample rows are scanned. "log_details": scanned 2133350 of 2133350 pages vacuumdb --analyze-only --all --verbose IN

Re: [GENERAL] vacuumdb uses a lot of disk

2013-08-15 Thread Kevin Grittner
Alexander Shutyaev wrote: > We have the following issue. When we use vacuumdb (NOT full) on > our postgres database (~320Gb) it takes up ~10Gb of disk space > which is never returned. Why is the space not returned? Does that happen every time?  (i.e., if you run vacuumdb 10 times in a row while

[GENERAL] vacuumdb uses a lot of disk

2013-08-14 Thread Alexander Shutyaev
Hi all! We have the following issue. When we use vacuumdb (NOT full) on our postgres database (~320Gb) it takes up ~10Gb of disk space which is never returned. Why is the space not returned? Thanks in advance!

Re: [GENERAL] vacuumdb with cronjob needs password since 9.0? SOLVED

2011-05-12 Thread Andreas Laggner
thank you depesz, your help was very useful! Am 12.05.2011 13:19, schrieb hubert depesz lubaczewski: On Thu, May 12, 2011 at 10:56:20AM +0200, Andreas Laggner wrote: Hi list, i always vaccumed my postgresql automatically with crontab, because autovacuum is not suitable for my applications. W

Re: [GENERAL] vacuumdb with cronjob needs password since 9.0?

2011-05-12 Thread hubert depesz lubaczewski
On Thu, May 12, 2011 at 10:56:20AM +0200, Andreas Laggner wrote: > Hi list, > > i always vaccumed my postgresql automatically with crontab, because > autovacuum is not suitable for my applications. With version 8.2 it > works perfect for me with this command line: > > 00 02 * * *postgres /usr

Re: [GENERAL] vacuumdb with cronjob needs password since 9.0?

2011-05-12 Thread Jerry Sievers
Andreas Laggner writes: > Hi list, > > i always vaccumed my postgresql automatically with crontab, because > autovacuum is not suitable for my applications. With version 8.2 it > works perfect for me with this command line: > > 00 02 * * *postgres /usr/bin/vacuumdb -d gis -z > > But not with

[GENERAL] vacuumdb with cronjob needs password since 9.0?

2011-05-12 Thread Andreas Laggner
Hi list, i always vaccumed my postgresql automatically with crontab, because autovacuum is not suitable for my applications. With version 8.2 it works perfect for me with this command line: 00 02 * * *postgres /usr/bin/vacuumdb -d gis -z But not with 9.0, because vacuumdb now wants to ha

Re: [GENERAL] Vacuumdb error

2011-04-15 Thread Tom Lane
Carl von Clausewitz writes: >>> sqlstate=23505ERROR: duplicate key value violates unique constraint >>> "pg_index_indexrelid_index" >>> sqlstate=23505DETAIL: Key (indexrelid)=(2678) already exists. After a considerable amount of fooling around I've been able to reproduce this and identify the c

Re: [GENERAL] Vacuumdb error

2011-04-14 Thread Carl von Clausewitz
Everything was fine, the reordered script fixed everything. Thanks all. Regards, Carl 2011/4/14 Carl von Clausewitz > Ok thanks, the information. I've made the mistake, I will change the > script, but I will try, that Vidhya told me. Let me see, what will going > on. > > Regards, > Carl > > 201

Re: [GENERAL] Vacuumdb error

2011-04-14 Thread Carl von Clausewitz
Ok thanks, the information. I've made the mistake, I will change the script, but I will try, that Vidhya told me. Let me see, what will going on. Regards, Carl 2011/4/14 Tom Lane > Carl von Clausewitz writes: > > Maintenance: > > #!/bin/sh > > date >> /var/log/postgresql_maintenance.log > > /u

Re: [GENERAL] Vacuumdb error

2011-04-14 Thread Tom Lane
Carl von Clausewitz writes: > Maintenance: > #!/bin/sh > date >> /var/log/postgresql_maintenance.log > /usr/local/bin/reindexdb --all --username=cvc >> > /var/log/postgresql_maintenance.log > echo "Reindex done" >> /var/log/postgresql_maintenance.log > /usr/local/bin/vacuumdb --all --full --analyz

Re: [GENERAL] Vacuumdb error

2011-04-14 Thread Carl von Clausewitz
Hi, see the two scripts attached. First one is the postgres_maintenance.sh, and the second is the postgres_backup.sh. I've attached it, and copied, because of the antivirus filters :-) regards, Carl Maintenance: #!/bin/sh date >> /var/log/postgresql_maintenance.log /usr/local/bin/reindexdb --all

Re: [GENERAL] Vacuumdb error

2011-04-14 Thread Tom Lane
Gipsz Jakab writes: > Today morning at 01:00 AM in our PostgreSQL 9.0.3 server a routine > maintenance script has started (vacuumdb --all --full --analyze), and > stopped with this error: > sqlstate=23505ERROR: duplicate key value violates unique constraint > "pg_index_indexrelid_index" > sqlsta

Re: [GENERAL] Vacuumdb error

2011-04-14 Thread Vidhya Bondre
Gipsz, We got this error too what we did is ran vacuum analyze verbose and afterthat reindexed the db and we din't see the error croping again. Regards Vidhya On Thu, Apr 14, 2011 at 5:26 PM, Gipsz Jakab wrote: > Dear List, > > Today morning at 01:00 AM in our PostgreSQL 9.0.3 server a routine

Re: [GENERAL] Vacuumdb error

2011-04-14 Thread Carl von Clausewitz
Ok, thanks, I'll try at night. Regards, Carl 2011/4/14 Vidhya Bondre > Gipsz, > > We got this error too what we did is ran vacuum analyze verbose and > afterthat reindexed the db and we din't see the error croping again. > > Regards > Vidhya > > On Thu, Apr 14, 2011 at 5:26 PM, Gipsz Jakab wrote

[GENERAL] Vacuumdb error

2011-04-14 Thread Gipsz Jakab
Dear List, Today morning at 01:00 AM in our PostgreSQL 9.0.3 server a routine maintenance script has started (vacuumdb --all --full --analyze), and stopped with this error: sqlstate=23505ERROR: duplicate key value violates unique constraint "pg_index_indexrelid_index" sqlstate=23505DETAIL: Key

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-09 Thread Scott Marlowe
On Tue, Feb 9, 2010 at 1:55 PM, John R Pierce wrote: > Guillaume Lelarge wrote: >>> >>> is this a 64bit postgres build? >>> >>> if not, you're probably running out of virtual address space in the 32 >>> bit user space, which is limited to like 2gb. >>> >>> >> >> IIRC, the virtual address space in

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-09 Thread John R Pierce
Guillaume Lelarge wrote: is this a 64bit postgres build? if not, you're probably running out of virtual address space in the 32 bit user space, which is limited to like 2gb. IIRC, the virtual address space in 32bit platforms is 4GB. it is, but within that 4gb, the kernel uses the to

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-09 Thread David Kerr
Magnus Hagander wrote: On Tue, Feb 9, 2010 at 09:53, David Kerr wrote: Guillaume Lelarge wrote: Le 09/02/2010 09:35, David Kerr a écrit : Guillaume Lelarge wrote: Le 09/02/2010 05:49, John R Pierce a écrit : David Kerr wrote: maintenance_work_mem = 1GB So evidently, when it tries to actua

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-09 Thread Magnus Hagander
On Tue, Feb 9, 2010 at 09:53, David Kerr wrote: > Guillaume Lelarge wrote: >> >> Le 09/02/2010 09:35, David Kerr a écrit : >>> >>> Guillaume Lelarge wrote: Le 09/02/2010 05:49, John R Pierce a écrit : > > David Kerr wrote: maintenance_work_mem = 1GB >>>

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-09 Thread David Kerr
Guillaume Lelarge wrote: Le 09/02/2010 09:35, David Kerr a écrit : Guillaume Lelarge wrote: Le 09/02/2010 05:49, John R Pierce a écrit : David Kerr wrote: maintenance_work_mem = 1GB So evidently, when it tries to actually allocate 1GB, it can't do it. Ergo, that setting is too high for your

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-09 Thread Guillaume Lelarge
Le 09/02/2010 09:35, David Kerr a écrit : > Guillaume Lelarge wrote: >> Le 09/02/2010 05:49, John R Pierce a écrit : >>> David Kerr wrote: >> maintenance_work_mem = 1GB > So evidently, when it tries to actually allocate 1GB, it can't do it. > Ergo, that setting is too high for your mach

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-09 Thread David Kerr
Guillaume Lelarge wrote: Le 09/02/2010 05:49, John R Pierce a écrit : David Kerr wrote: maintenance_work_mem = 1GB So evidently, when it tries to actually allocate 1GB, it can't do it. Ergo, that setting is too high for your machine. ... seems like i've got 2GB free. is this a 64bit postgre

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-09 Thread Guillaume Lelarge
Le 09/02/2010 05:49, John R Pierce a écrit : > David Kerr wrote: maintenance_work_mem = 1GB >>> >>> So evidently, when it tries to actually allocate 1GB, it can't do it. >>> Ergo, that setting is too high for your machine. >>> ... >> >> seems like i've got 2GB free. > > > is this a 64bit pos

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-08 Thread John R Pierce
David Kerr wrote: maintenance_work_mem = 1GB So evidently, when it tries to actually allocate 1GB, it can't do it. Ergo, that setting is too high for your machine. ... seems like i've got 2GB free. is this a 64bit postgres build? if not, you're probably running out of virtual address spa

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-08 Thread David Kerr
Tom Lane wrote: David Kerr writes: Tom Lane wrote: David Kerr writes: I get: vacuumdb: vacuuming of database "assessment" failed: ERROR: out of memory DETAIL: Failed on request of size 1073741820. What have you got maintenance_work_mem set to? maintenance_work_mem = 1GB So evidently,

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-08 Thread Tom Lane
David Kerr writes: > Tom Lane wrote: >> David Kerr writes: >>> I get: >>> vacuumdb: vacuuming of database "assessment" failed: ERROR: out of memory >>> DETAIL: Failed on request of size 1073741820. >> >> What have you got maintenance_work_mem set to? > maintenance_work_mem = 1GB So evidently

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-08 Thread David Kerr
Tom Lane wrote: David Kerr writes: I'm getting error: When I try vacuumdb -z assessment or vacuumdb assessment I get: vacuumdb: vacuuming of database "assessment" failed: ERROR: out of memory DETAIL: Failed on request of size 1073741820. What have you got maintenance_work_mem set to?

Re: [GENERAL] vacuumdb ERROR: out of memory

2010-02-08 Thread Tom Lane
David Kerr writes: > I'm getting error: > When I try > vacuumdb -z assessment > or > vacuumdb assessment > I get: > vacuumdb: vacuuming of database "assessment" failed: ERROR: out of memory > DETAIL: Failed on request of size 1073741820. What have you got maintenance_work_mem set to?

[GENERAL] vacuumdb ERROR: out of memory

2010-02-08 Thread David Kerr
I'm getting error: When I try vacuumdb -z assessment or vacuumdb assessment I get: vacuumdb: vacuuming of database "assessment" failed: ERROR: out of memory DETAIL: Failed on request of size 1073741820. The only way i can actually analyze the DB is if i do a vacuumdb -f The database is curren

Re: [GENERAL] vacuumdb -z do a reindex?

2009-11-29 Thread Irene Barg
Hi Scott, On Sat, Nov 28, 2009 at 3:12 PM, Irene Barg wrote: > Hi Scott, > > Scott Marlowe wrote: >> >> On Fri, Nov 27, 2009 at 2:17 PM, Irene Barg wrote: >>> >>> I've had a simple update running for over 4 hours now (see results from >>> pg_top below). The sql is: >> >> Have you looked in

Re: [GENERAL] vacuumdb -z do a reindex?

2009-11-28 Thread Scott Marlowe
On Sat, Nov 28, 2009 at 3:12 PM, Irene Barg wrote: > Hi Scott, > > Scott Marlowe wrote: >> >> On Fri, Nov 27, 2009 at 2:17 PM, Irene Barg wrote: >>> >>> I've had a simple update running for over 4 hours now (see results from >>> pg_top below). The sql is: >> >> Have you looked in pg_locks and pg_

Re: [GENERAL] vacuumdb -z do a reindex?

2009-11-28 Thread John R Pierce
Irene Barg wrote: avg-cpu: %user %nice %system %iowait %steal %idle 0.000.000.010.000.00 99.99 Device: rrqm/s wrqm/s r/s w/s rsec/s wsec/s avgrq-sz avgqu-sz await svctm %util sda 0.00 0.60 0.00 1.00 0.0012.80

Re: [GENERAL] vacuumdb -z do a reindex?

2009-11-28 Thread Irene Barg
Hi Scott, Scott Marlowe wrote: On Fri, Nov 27, 2009 at 2:17 PM, Irene Barg wrote: I've had a simple update running for over 4 hours now (see results from pg_top below). The sql is: Have you looked in pg_locks and pg_stat_activity? Yes, I did look at pg_stat_activity and did not see anythin

Re: [GENERAL] vacuumdb -z do a reindex?

2009-11-27 Thread Scott Marlowe
On Fri, Nov 27, 2009 at 2:17 PM, Irene Barg wrote: > I've had a simple update running for over 4 hours now (see results from > pg_top below). The sql is: Have you looked in pg_locks and pg_stat_activity? > The database has 1016789 records, vacuumdb -z is ran once a day. I have not > ran 'reindex

Re: [GENERAL] vacuumdb -z do a reindex?

2009-11-27 Thread Guillaume Lelarge
Le vendredi 27 novembre 2009 à 22:17:50, Irene Barg a écrit : > I thought 'vacuumdb -z dbname' also reindex is this true? > No. vacuumdb -z is a VACUUM ANALYZE. Moreover, vacuumdb has no option to do a REINDEX. -- Guillaume. http://www.postgresqlfr.org http://dalibo.com -- Sent via pgsql-

[GENERAL] vacuumdb -z do a reindex?

2009-11-27 Thread Irene Barg
I thought 'vacuumdb -z dbname' also reindex is this true? I've had a simple update running for over 4 hours now (see results from pg_top below). The sql is: The database has 1016789 records, vacuumdb -z is ran once a day. I have not ran 'reindexdb' in weeks. The system is a: 2xIntel 4-core

Re: [GENERAL] vacuumdb: vacuuming of database "xy" failed: PANIC: corrupted item pointer: 19227

2009-11-18 Thread Thom Brown
2009/11/18 Tech 2010 : > Hello! > > How do I location of this pointer and how do I zero it so I can access > the rest of the data? > > "zero_damaged_pages = true" did not help in this case, because I > always get same numbers being zeroed. This is with 8.4.0 and 8.4.1. > > Thanks. > You probably j

[GENERAL] vacuumdb: vacuuming of database "xy" failed: PANIC: corrupted item pointer: 19227

2009-11-18 Thread Tech 2010
Hello! How do I location of this pointer and how do I zero it so I can access the rest of the data? "zero_damaged_pages = true" did not help in this case, because I always get same numbers being zeroed. This is with 8.4.0 and 8.4.1. Thanks. -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-06 Thread APseudoUtopia
On Thu, Oct 1, 2009 at 5:02 PM, Tom Lane wrote: > APseudoUtopia writes: >>> Here's what happened: >>> >>> $ vacuumdb --all --full --analyze --no-password >>> vacuumdb: vacuuming database "postgres" >>> vacuumdb: vacuuming database "web_main" >>> vacuumdb: vacuuming of database "web_main" failed:

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-02 Thread Tom Lane
Teodor Sigaev writes: > ginHeapTupleFastCollect and ginEntryInsert checked tuple's size for > TOAST_INDEX_TARGET, but ginHeapTupleFastCollect checks without one > ItemPointer, > as ginEntryInsert does it. So ginHeapTupleFastCollect could produce a tuple > which 6-bytes larger than allowed by g

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-02 Thread Tom Lane
Teodor Sigaev writes: >> Will you apply this, or do you want me to? > I'm not able to provide a good error message in good English :( OK, I'll take care of it later today. regards, tom lane -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make c

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-02 Thread Teodor Sigaev
Looks reasonable, although since the error is potentially user-facing I think we should put a bit more effort into the error message (use ereport and make it mention the index name, at least --- is there any other useful information we could give?) Only sizes as it's done in BTree, I suppose. W

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-02 Thread Tom Lane
Teodor Sigaev writes: > Patch removes checking of TOAST_INDEX_TARGET and use checking only by > GinMaxItemSize which is greater than TOAST_INDEX_TARGET. All size's check is > now > in GinFormTuple. Looks reasonable, although since the error is potentially user-facing I think we should put a bi

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-02 Thread Teodor Sigaev
APseudoUtopia writes: Here's what happened: $ vacuumdb --all --full --analyze --no-password vacuumdb: vacuuming database "postgres" vacuumdb: vacuuming database "web_main" vacuumdb: vacuuming of database "web_main" failed: ERROR: б═huge tuple PostgreSQL 8.4.0 on i386-portbld-freebsd7.2, comp

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-01 Thread Tom Lane
APseudoUtopia writes: >> Here's what happened: >> >> $ vacuumdb --all --full --analyze --no-password >> vacuumdb: vacuuming database "postgres" >> vacuumdb: vacuuming database "web_main" >> vacuumdb: vacuuming of database "web_main" failed: ERROR:  huge tuple > PostgreSQL 8.4.0 on i386-portbld-

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-01 Thread Alvaro Herrera
Scott Marlowe escribió: > Wow, that's pretty slow. I'd assumed it was a semi-automated process > and the new version would be out now, 3 weeks later. At least look > through the release notes to see if any mention is made of this bug > being fixed in 8.4.1 I guess. Both files on which that erro

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-01 Thread Scott Marlowe
On Thu, Oct 1, 2009 at 2:27 PM, APseudoUtopia wrote: > On Thu, Oct 1, 2009 at 4:21 PM, Scott Marlowe wrote: >> On Thu, Oct 1, 2009 at 1:12 PM, APseudoUtopia >> wrote: >> >>> Sorry, I failed to mention: >>> >>> PostgreSQL 8.4.0 on i386-portbld-freebsd7.2, compiled by GCC cc (GCC) >>> 4.2.1 20070

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-01 Thread APseudoUtopia
On Thu, Oct 1, 2009 at 4:21 PM, Scott Marlowe wrote: > On Thu, Oct 1, 2009 at 1:12 PM, APseudoUtopia wrote: > >> Sorry, I failed to mention: >> >> PostgreSQL 8.4.0 on i386-portbld-freebsd7.2, compiled by GCC cc (GCC) >> 4.2.1 20070719  [FreeBSD], 32-bit > > Have you tried updating to 8.4.1 to see

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-01 Thread Scott Marlowe
On Thu, Oct 1, 2009 at 1:12 PM, APseudoUtopia wrote: > Sorry, I failed to mention: > > PostgreSQL 8.4.0 on i386-portbld-freebsd7.2, compiled by GCC cc (GCC) > 4.2.1 20070719  [FreeBSD], 32-bit Have you tried updating to 8.4.1 to see if that fixes the problem? -- Sent via pgsql-general mailing

Re: [GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-01 Thread APseudoUtopia
On Thu, Oct 1, 2009 at 3:10 PM, APseudoUtopia wrote: > Hey list, > > After some downtime of my site while completing rigorous database > maintenance, I wanted to make sure all the databases were fully > vacuumed and analyzed. I do run autovacuum, but since I made several > significant changes, I w

[GENERAL] Vacuumdb Fails: Huge Tuple

2009-10-01 Thread APseudoUtopia
Hey list, After some downtime of my site while completing rigorous database maintenance, I wanted to make sure all the databases were fully vacuumed and analyzed. I do run autovacuum, but since I made several significant changes, I wanted to force a vacuum before I brought my site back online. He

Re: [GENERAL] vacuumdb: PANIC: corrupted item pointer

2007-07-10 Thread Tom Lane
Richard Huxton <[EMAIL PROTECTED]> writes: >> First try was using a file system copy to reduce downtime as it was two >> same 7.4.x version but the result was not working (maybe related to >> architecture change 32bits => 64 bits) so I finally dropped the db and >> performed an dump/restore. I t

Re: [GENERAL] vacuumdb: PANIC: corrupted item pointer

2007-07-10 Thread Richard Huxton
AlJeux wrote: Richard Huxton a écrit : 1. Have you had crashes or other hardware problems recently? No crash but we changed our server (<= seems the cause). First try was using a file system copy to reduce downtime as it was two same 7.4.x version but the result was not working (maybe relate

Re: [GENERAL] vacuumdb: PANIC: corrupted item pointer

2007-07-10 Thread AlJeux
Richard Huxton a écrit : Alain wrote: Hello, System: Red Hat Linux 4 64bits running postgres-7.4.16 (production) Initial problem: # pg_dump -O dbname -Ft -f /tmp/database.tar pg_dump: query to get table columns failed: ERROR: invalid memory alloc request size 9000688640 After so

Re: [GENERAL] vacuumdb: PANIC: corrupted item pointer

2007-07-10 Thread Tom Lane
Richard Huxton <[EMAIL PROTECTED]> writes: > Tom Lane wrote: >> FWIW, a look in the source code shows that the 'corrupted item pointer' >> message comes only from PageIndexTupleDelete, so that indicates a >> damaged index which should be fixable by reindexing. > Tom - could it be damage to a share

Re: [GENERAL] vacuumdb: PANIC: corrupted item pointer

2007-07-10 Thread Richard Huxton
Tom Lane wrote: Richard Huxton <[EMAIL PROTECTED]> writes: Alain Peyrat wrote: Initial problem: # pg_dump -O dbname -Ft -f /tmp/database.tar pg_dump: query to get table columns failed: ERROR: invalid memory alloc request size 9000688640 After some research, it seems to be related to a corr

Re: [GENERAL] vacuumdb: PANIC: corrupted item pointer

2007-07-10 Thread Tom Lane
Richard Huxton <[EMAIL PROTECTED]> writes: > Alain Peyrat wrote: >> Initial problem: >> >> # pg_dump -O dbname -Ft -f /tmp/database.tar >> pg_dump: query to get table columns failed: ERROR: invalid memory alloc >> request size 9000688640 >> >> After some research, it seems to be related to a co

Re: [GENERAL] vacuumdb: PANIC: corrupted item pointer

2007-07-10 Thread Richard Huxton
Alain Peyrat wrote: Hello, System: Red Hat Linux 4 64bits running postgres-7.4.16 (production) Initial problem: # pg_dump -O dbname -Ft -f /tmp/database.tar pg_dump: query to get table columns failed: ERROR: invalid memory alloc request size 9000688640 After some research, it see

[GENERAL] vacuumdb: PANIC: corrupted item pointer

2007-07-10 Thread Alain Peyrat
Hello, System: Red Hat Linux 4 64bits running postgres-7.4.16 (production) Initial problem: # pg_dump -O dbname -Ft -f /tmp/database.tar pg_dump: query to get table columns failed: ERROR:  invalid memory alloc request size 9000688640 After some research, it seems to be related t

Re: [GENERAL] vacuumdb out of memory error

2006-02-15 Thread Matthew T. O'Connor
Tom Lane wrote: "Matthew T. O'Connor" writes: PostgreSQL 8.1.0 on i686-redhat-linux-gnu, compiled by GCC gcc (GCC) 3.3.3 20040412 (Red Hat Linux 3.3.3-7) ... and this should definitely make you nervous. We don't release update versions for idle amusement. Get onto 8.1.3 and see if

Re: [GENERAL] vacuumdb out of memory error

2006-02-15 Thread Tom Lane
"Matthew T. O'Connor" writes: > no tables in it. I logged into my server and reran the vacuumdb -a -z > command and it went though with no problem. I also checked my log file > and it shows that there have been 25 out of memory errors on my server > today. > My question is: Is this normal?

[GENERAL] vacuumdb out of memory error

2006-02-15 Thread Matthew T. O'Connor
Hello all, I run a nightly "vacuumdb -a -z" on my production server. The output of the command is emailed to me every night. Today while checking my email I received this: vacuumdb: vacuuming database "postgres" vacuumdb: vacuuming of database "postgres" failed: ERROR: out of memory DETAIL

Re: [GENERAL] Vacuumdb question

2005-07-20 Thread Mario Guenterberg
go schrieb: > Hi, pgsql-general. > > Explain me please the difference between > Vacuum full and Vacuum freeze > See you: http://www.postgresql.org/docs/8.0/interactive/sql-vacuum.html -- Mario Günterberg mattheis. werbeagentur IT Engineer / Projektleiter Zillestrasse 105a. D - 10585 Berlin

[GENERAL] Vacuumdb question

2005-07-20 Thread go
Hi, pgsql-general. Explain me please the difference between Vacuum full and Vacuum freeze -- Have a nice day! go mailto:[EMAIL PROTECTED] ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster

[GENERAL] vacuumdb suggestions?

2005-06-15 Thread David Siebert
I have three scripts that I am running to do pg_dumpall and a vacuum on my server. one is run every night except Sundays. one is run every Sunday night. one is run the first of each month. After I ftp the backup to a standby server the vacuum is run. The database is pretty small it only grows by

Re: [GENERAL] vacuumdb

2004-12-11 Thread Bruno Wolff III
On Wed, Dec 08, 2004 at 09:45:53 -0800, Mark <[EMAIL PROTECTED]> wrote: > Hi, > What are recommendations about running vacuumdb? You need to VACUUM tables to reclaim space created by DELETE and UPDATE commands. You need to run ANALYZE tables when their distribution of data changes. If you are do

[GENERAL] vacuumdb

2004-12-11 Thread Mark
Hi, What are recommendations about running vacuumdb? How frequently it need be executed and how will I know I have to run it. Can I run vaccumdb on production system or I need to do it on DB with no users connected? Thanks, Mark. __ Do you Yaho

Re: [GENERAL] vacuumdb hanging database cluster

2004-07-26 Thread Tom Lane
Steve Crawford <[EMAIL PROTECTED]> writes: >>> I tracked down the process that was "idle in transaction" and it >>> was a pg_dump process running on another machine. >> >> What was it waiting on? > Beats the heck out of me. We periodically dump some selected small > tables via a script using: >

Re: [GENERAL] vacuumdb hanging database cluster

2004-07-26 Thread Steve Crawford
On Monday 26 July 2004 2:18 pm, Tom Lane wrote: > Steve Crawford <[EMAIL PROTECTED]> writes: > > A couple hundred processes were showing as "startup waiting" and > > one was "idle in transaction". The process in the "VACUUM > > waiting" state was the only one connected to that database - all > > ot

Re: [GENERAL] vacuumdb hanging database cluster

2004-07-26 Thread Tom Lane
Steve Crawford <[EMAIL PROTECTED]> writes: > A couple hundred processes were showing as "startup waiting" and one > was "idle in transaction". The process in the "VACUUM waiting" state > was the only one connected to that database - all other connections > were to other databases. I suspect wha

Re: [GENERAL] vacuumdb hanging database cluster

2004-07-26 Thread Dann Corbit
> -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > Steve Crawford > Sent: Monday, July 26, 2004 1:23 PM > To: [EMAIL PROTECTED] > Subject: [GENERAL] vacuumdb hanging database cluster > > > When I run: > vacuumdb --

[GENERAL] vacuumdb hanging database cluster

2004-07-26 Thread Steve Crawford
When I run: vacuumdb --full --all --analyze --quiet on my database cluster it will complete in < 2 minutes (this cluster is a few million total rows and ~2GB). After testing, I set this up as an off-hours cron job and it worked fine for several days then hung the whole database. After my pager

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT

2004-05-12 Thread Andrew Sullivan
On Mon, May 10, 2004 at 07:49:42PM -0400, Tom Lane wrote: > > Hmm, I would expect that behavior for an overwrite-in-place REINDEX, > but 7.2 only seems to use overwrite-in-place for critical system > catalogs. What were you reindexing exactly? Were you running a > standalone backend? Not as far

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT

2004-05-10 Thread Tom Lane
Andrew Sullivan <[EMAIL PROTECTED]> writes: > Dunno if this is any help, but on a 7.2 system I saw a REINDEX which > was interrupted leave the index at least partially working. We ended > up with an index which seemed fine, but which didn't contain certain > rows (so those rows were not visible wh

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT

2004-05-09 Thread Denis Braekhus
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Tom Lane wrote: |>Indicating that they should produce the same results, but that they work |>differently. I am not sure what that implies, but maybe someone else knows ? | The only difference the docs are talking about is what kind of lock is | held whi

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT

2004-05-08 Thread Tom Lane
Denis Braekhus <[EMAIL PROTECTED]> writes: > Indicating that they should produce the same results, but that they work > differently. I am not sure what that implies, but maybe someone else knows ? The only difference the docs are talking about is what kind of lock is held while the rebuild proceed

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT

2004-05-08 Thread Denis Braekhus
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Lonni Friedman wrote: | Thanks for your reply. I thought (perhaps erroneously) that there | wasn't any real difference between dropping an index then recreating | it, and just reindexing an index? I am definitely not sure, and I agree it sounds logica

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT THE SAME AS HEAP

2004-05-07 Thread Lonni Friedman
Thanks for your reply. I thought (perhaps erroneously) that there wasn't any real difference between dropping an index then recreating it, and just reindexing an index? On Thu, 06 May 2004 23:00:25 +0200, Denis Braekhus <[EMAIL PROTECTED]> wrote: > > -BEGIN PGP SIGNED MESSAGE- > Hash: SH

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT THE SAME AS HEAP

2004-05-05 Thread Tom Lane
Lonni Friedman <[EMAIL PROTECTED]> writes: > hrmmm, i'm not sure what would constitute 'off the beaten track'. Neither am I ... if we knew what you were doing that triggers the bug, we'd already be halfway there :-( regards, tom lane ---(end of bro

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT THE SAME AS HEAP

2004-05-05 Thread Lonni Friedman
On Wed, 05 May 2004 13:56:41 -0400, Tom Lane <[EMAIL PROTECTED]> wrote: > Lonni Friedman <[EMAIL PROTECTED]> writes: > > On Wed, 05 May 2004 12:31:21 -0400, Tom Lane <[EMAIL PROTECTED]> wrote: > >> Once the complaint starts appearing, I'd expect it to continue until you > >> reindex the index. > >

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT THE SAME AS HEAP

2004-05-05 Thread Lonni Friedman
On Wed, 05 May 2004 12:31:21 -0400, Tom Lane <[EMAIL PROTECTED]> wrote: > > Lonni Friedman <[EMAIL PROTECTED]> writes: > > Unfortunately, i have no clue how to replicate this. It was happening > > fairly consistantly before i upgraded from 7.3.3 to 7.3.4 (like nearly > > every vacuumdb run). > >

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT THE SAME AS HEAP

2004-05-05 Thread Tom Lane
Lonni Friedman <[EMAIL PROTECTED]> writes: > On Wed, 05 May 2004 12:31:21 -0400, Tom Lane <[EMAIL PROTECTED]> wrote: >> Once the complaint starts appearing, I'd expect it to continue until you >> reindex the index. > That's exactly what happens. It consistantly errors until reindexed. > Any sugg

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT THE SAME AS HEAP

2004-05-05 Thread Lonni Friedman
Its _always_ that same index. No others have had this problem. Unfortunately, i have no clue how to replicate this. It was happening fairly consistantly before i upgraded from 7.3.3 to 7.3.4 (like nearly every vacuumdb run). Then nothing for a month after going to 7.3.4, and now its happening e

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT THE SAME AS HEAP

2004-05-05 Thread Tom Lane
Lonni Friedman <[EMAIL PROTECTED]> writes: > Unfortunately, i have no clue how to replicate this. It was happening > fairly consistantly before i upgraded from 7.3.3 to 7.3.4 (like nearly > every vacuumdb run). > Then nothing for a month after going to 7.3.4, and now its happening > every vacuumd

Re: [GENERAL] vacuumdb is failing with NUMBER OF INDEX TUPLES NOT THE SAME AS HEAP

2004-05-05 Thread Tom Lane
Lonni Friedman <[EMAIL PROTECTED]> writes: > All of a sudden last month (after about 3 years) I started getting > this warning when vacuumdb was run: > INFO: Index pg_largeobject_loid_pn_index: Pages 903; Tuples 323847: > Deleted 0.CPU 0.04s/0.07u sec elapsed 0.10 sec. > WARNING: Index pg_la

Re: [GENERAL] Vacuumdb Errors --Any ideas?

2004-05-02 Thread Keary Suska
on 5/1/04 3:11 PM, [EMAIL PROTECTED] purportedly said: > Keary Suska <[EMAIL PROTECTED]> writes: >> I received the following errors from an automated full vacuum: >> vacuumdb: vacuuming of database "milemgr" failed: ERROR: tuple concurrently >> updated > > Hm, could you have had more than one of

Re: [GENERAL] Vacuumdb Errors --Any ideas?

2004-05-01 Thread Tom Lane
Keary Suska <[EMAIL PROTECTED]> writes: > I received the following errors from an automated full vacuum: > vacuumdb: vacuuming of database "milemgr" failed: ERROR: tuple concurrently > updated Hm, could you have had more than one of these beasts running? It's possible to get such an error from c

Re: [GENERAL] Vacuumdb message: AbortTransaction and not in-progress ...

2001-05-23 Thread Tom Lane
Gabriel Fernandez <[EMAIL PROTECTED]> writes: > We have some db's in our server. When executing a vacuumdb, ONLY FOR > SOME of them, the following message is shown: > AbortTransaction and not in in-progress state What postgres version? > After this, the vacuum process is aborted, so we cannot v

[GENERAL] Vacuumdb message: AbortTransaction and not in-progress ...

2001-05-23 Thread Gabriel Fernandez
Hi, We have some db's in our server. When executing a vacuumdb, ONLY FOR SOME of them, the following message is shown: AbortTransaction and not in in-progress state After this, the vacuum process is aborted, so we cannot vacuum these 'problematic' db's. What can we do ? Gabi :-) --

[GENERAL] vacuumdb question

2001-02-16 Thread jdaniels1973
Hi, What exactly does vacuumdb do? In what way does it 'clean' the db? Also what are the best ways to optimise a pg databaseThanks, Jonathan Daniels

Re: [GENERAL] vacuumdb can't find libraries

2000-10-19 Thread Joseph Shraibman
KuroiNeko wrote: > > Ray, > > > What am I doing wrong? Any ideas wold be helpful! > > Environment is dropped by cron. Either specify LD_LIBRARY_PATH in crontab > explicitly, or add your PG libdir to /etc/ld.so.conf and rerun ldconfig. > Or do what I do in my cron scripts: . ~/.bashrc ; myc

RE: [GENERAL] vacuumdb failed

2000-08-30 Thread Hiroshi Inoue
> -Original Message- > From: Tom Lane > > > Now, I'm not sure if this is related, but while trying to > do vacuumdb > > , I got... > > > NOTICE: FlushRelationBuffers(all_flows, 500237): block 171439 is > > referenced (private 0, global 1) > > FATAL 1: VACUUM (vc_repair_frag): Flush

Re: [GENERAL] vacuumdb failed

2000-08-27 Thread Tom Lane
George Robinson II <[EMAIL PROTECTED]> writes: > Last night, while my perl script was doing a huge insert operation, I > got this error... > DBD::Pg::st execute failed: ERROR: copy: line 4857, pg_atoi: error > reading "2244904358": Result too large > Now, I'm not sure if this is rel

Re: [GENERAL] vacuumdb problem

2000-07-02 Thread Tom Lane
Marcin Inkielman <[EMAIL PROTECTED]> writes: > NOTICE: FlushRelationBuffers(osoby, 228): block 223 is referenced > (private 0, global 1) > FATAL 1: VACUUM (vc_repair_frag): FlushRelationBuffers returned -2 > this table is referenced in my db by a tree of FOREIGN KEYs. Hmm, I wonder whether th

[GENERAL] vacuumdb problem

2000-07-02 Thread Marcin Inkielman
Hi! I have a problem with vacuumdb on one of my tables. (spiral:3)-[~]$vacuumdb -t osoby -v dziekanat NOTICE: --Relation osoby-- NOTICE: Pages 229: Changed 0, reaped 16, Empty 0, New 0; Tup 4427: Vac 5, Keep/VTL 0/0, Crash 0, UnUsed 70, MinLen 64, MaxLen 616; Re-using: Free/Avail. Space 18176/