[GENERAL] Optimizations

2010-03-05 Thread Ogden
We run a student scoring system with PostgreSQL as a backend. After the results for each student are inputted into the system, we display many reports for them. We haven't had a problem with efficiency or speed, but it has come up that perhaps storing the rolled up scores of each student may be

Re: [GENERAL] Optimizations

2010-03-05 Thread Craig Ringer
Ogden wrote: > We run a student scoring system with PostgreSQL as a backend. After the > results for each student are inputted into the system, we display many > reports for them. We haven't had a problem with efficiency or speed, but it > has come up that perhaps storing the rolled up scores of

Re: [GENERAL] ERROR: row is too big: size 8176, maximum size 8160

2010-03-05 Thread Scott Marlowe
On Fri, Mar 5, 2010 at 12:55 AM, Albe Laurenz wrote: > Andreas Kretschmer wrote: >> > I am using postgresql-8.3.7 and have recently got this error: >> > >> > org.postgresql.util.PSQLException: ERROR: row is too big: size 8168, >> > maximum size 8160 >> >> Please show us your table definition. >> >

Re: [GENERAL] Failed to run initdb: 128

2010-03-05 Thread Richard Huxton
On 04/03/10 20:43, Niranjan Maturi (nmaturi) wrote: Hi Thanks for the reply. Yes, I saw that "2769" is related to locales. On the machine, I saw a new locale called "C" is installed. I am not sure how it got installed. By default, this locale was getting selected. I did select "English - united

Re: [GENERAL] need some advanced books on Postgres

2010-03-05 Thread Richard Huxton
On 05/03/10 01:27, Thomas wrote: sigh,I didn't find a book with enough internal topics. You're never going to see a book covering the PostgreSQL internals. You'd sell (at most) 100 copies and need to do major updates once a year. It'd be several months work to write and only a handful of peop

Re: [GENERAL] ERROR: row is too big: size 8176, maximum size 8160

2010-03-05 Thread Albe Laurenz
Scott Marlowe wrote: I am using postgresql-8.3.7 and have recently got this error: org.postgresql.util.PSQLException: ERROR: row is too big: size 8168, maximum size 8160 >>> >>> Please show us your table definition. >>> >>> Wild guess: you have many, many columns, non-text (INT

Re: [GENERAL] join from multiple tables

2010-03-05 Thread Grzegorz Jaśkiewicz
altho not an answer to your question, you might want to start using table name aliases, to make queries more readable. so instead of: SELECT dsclient_logs.ev_id,dsclient_ logs.type,to_timestamp(dsclient_logs.ev_time) as timestamp,dsclient_logs.category,dsclient_logs.error,dsclient_logs.ev_text,ds

Re: [GENERAL] Restore Data Encountered the ERROR: literal carriage return found in data Error

2010-03-05 Thread Richard Huxton
On 04/03/10 23:52, Wang, Mary Y wrote: Hi All, After a pg_dumpall, I'm trying to restore with psql -e template1 -f 21.bak&>/tmp/out21.bak . I'm trying to migrate to Postgres 8.3.8. Are you running pg_dumpall from version 8.3.8? I'm getting lots errors like this one: "psql:21.bak:340557: ERR

Re: [GENERAL] Foreign key behavior different in a function and outside

2010-03-05 Thread Richard Huxton
On 05/03/10 06:45, Mridula Mahadevan wrote: Thanks for the response Tom. I am running postgres 8.3.7. Yes, his is a highly simplified version, but I also didn't get the column name right. The core issue is the foreign key reference being deleted even though there is no cascade delete defined.

[GENERAL] Is there any oracle user_source table equivalent in postgre?

2010-03-05 Thread venkatrao . b
Hello, Can any one help me if oracle like any user_source table is there in postgre 8.4 (in pg_catalog or information_schema). Actually we migrated code from Oracle to Postgre. Now i want to search in how many places( i.e. in functions ) we have used a particular syntax( e.g. current_date). Thi

Re: [GENERAL] Is there any oracle user_source table equivalent in postgre?

2010-03-05 Thread Thomas Kellerer
venkatra...@tcs.com, 05.03.2010 12:40: Hello, Can any one help me if oracle like any user_source table is there in postgre 8.4 (in pg_catalog or information_schema). Actually we migrated code from Oracle to Postgre. Now i want to search in how many places( i.e. in functions ) we have used a par

Re: [GENERAL] [NOVICE] Is there any oracle user_source table equivalent in postgre?

2010-03-05 Thread Vibhor Kumar
> > Hello, > > Can any one help me if oracle like any user_source table is there in postgre > 8.4 (in pg_catalog or information_schema). > Actually we migrated code from Oracle to Postgre. Now i want to search in how > many places( i.e. in functions ) we have used a particular syntax( e.g.

Re: [GENERAL] [NOVICE] Is there any oracle user_source table equivalent in postgre?

2010-03-05 Thread venkatrao . b
Thanks Thomas for your reply. when i am trying - select * from pg_catalog.pg_proc.prosrc i am getting error - cross database reference is not implemented. Also i am not able to see this table under pg_catalog node in pgAdmin tool. Same thing is happening with pg_catalog.pg_views.definition. Ca

Re: [GENERAL] [NOVICE] Is there any oracle user_source table equivalent in postgre?

2010-03-05 Thread Pavel Stehule
2010/3/5 > > > Thanks Thomas for your reply. > > when i am trying - > > select * from pg_catalog.pg_proc.prosrc > prosrc is column name do just select prosrc from pg_proc; regards Pavel > i am getting error - cross database reference is not implemented. Also i am > not able to see this table

[GENERAL] Re: [NOVICE] Is there any oracle user_source table equivalent in postgre?

2010-03-05 Thread Devrim GÜNDÜZ
On Fri, 2010-03-05 at 17:34 +0530, venkatra...@tcs.com wrote: > > when i am trying - > > select * from pg_catalog.pg_proc.prosrc SELECT prosrc FROM pg_catalog.pg_proc; -- Devrim GÜNDÜZ PostgreSQL Danışmanı/Consultant, Red Hat Certified Engineer devrim~gunduz.org, devrim~PostgreSQL.org, devrim

[GENERAL] Re: [NOVICE] Is there any oracle user_source table equivalent in postgre?

2010-03-05 Thread Thomas Kellerer
venkatra...@tcs.com, 05.03.2010 13:04: Thanks Thomas for your reply. when i am trying - select * from pg_catalog.pg_proc.prosrc You have to use: SELECT prosrc FROM pg_catalog.pg_proc Thomas -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your su

Re: [GENERAL] [NOVICE] Is there any oracle user_source table equivalent in postgre?

2010-03-05 Thread venkatrao . b
Thanks to you all it worked.. From: Devrim GÜNDÜZ To: venkatra...@tcs.com Cc: pgsql-general@postgresql.org, pgsql-nov...@postgresql.org Date: 03/05/2010 05:41 PM Subject: Re: [NOVICE] Is there any oracle user_source table equivalent in postgre? Sent by: pgsql-novice-ow...@postgresql.org O

[GENERAL] Xpath Index in PostgreSQL

2010-03-05 Thread Chris Roffler
I am trying to setup an index on an xpath expression but the query never uses the index. Could someone enlighten me please ? Here is the setup : CREATE TABLE time_series ( id bigint NOT NULL, "name" character varying NOT NULL, "timestamp" timestamp with time zone NOT NULL, start_date time

Re: [GENERAL] Xpath Index in PostgreSQL

2010-03-05 Thread Tom Lane
Chris Roffler writes: > I am trying to setup an index on an xpath expression but the query never > uses the index. > Could someone enlighten me please ? > Here is the setup : > CREATE INDEX xml_index > ON time_series > USING btree > ((xpath('/AttributeList/Attributes/Attribute/Name/text()'

Re: [GENERAL] ERROR: row is too big: size 8176, maximum size 8160

2010-03-05 Thread Tom Lane
Scott Marlowe writes: > On Fri, Mar 5, 2010 at 12:55 AM, Albe Laurenz wrote: >> Or maybe a large column has been modified by >> ALTER TABLE ... ALTER COLUMN ... SET STORAGE PLAIN > I thought even then if the backend can't fit it all in 8k it puts text > out of line. No, SET STORAGE PLAIN is an

Re: [GENERAL] need some advanced books on Postgres

2010-03-05 Thread Tom Lane
Richard Huxton writes: > On 05/03/10 01:27, Thomas wrote: >> sigh,I didn't find a book with enough internal topics. > You're never going to see a book covering the PostgreSQL internals. The way you're meant to learn about that is to read the source code. Start with http://developer.postgresql.o

Re: [GENERAL] Restore Data Encountered the ERROR: literal carriage return found in data Error

2010-03-05 Thread Tom Lane
Richard Huxton writes: > On 04/03/10 23:52, Wang, Mary Y wrote: >> I'm getting lots errors like this one: "psql:21.bak:340557: ERROR: >> literal carriage return found in data HINT: Use "\r" to represent >> carriage return." > I'd only expect this if an old pg_dumpall was being used. Mary's deal

Re: [GENERAL] Optimizations

2010-03-05 Thread Ogden
On Mar 5, 2010, at 2:26 AM, Craig Ringer wrote: > Ogden wrote: >> We run a student scoring system with PostgreSQL as a backend. After the >> results for each student are inputted into the system, we display many >> reports for them. We haven't had a problem with efficiency or speed, but it >> h

Re: [GENERAL] Xpath Index in PostgreSQL

2010-03-05 Thread Chris Roffler
Thanks for your fast response I have the following sql statement now : CREATE INDEX xml_index ON time_series USING btree (xpath('/AttributeList/Attributes/Attribute/Name/text()',external_attributes))[1]::text And I am getting the following error : ERROR: syntax error at or near "[" LINE 6

Re: [GENERAL] Auto VACUUM

2010-03-05 Thread akp geek
Hi All - I am still having the issue, even after I turned on the auto vaccum. I have quick question. How do I know that auto vacuum process is running. When I restarted my database , I got the message auto vacuum launcher started. But is there a way that I can check that the process i

Re: [GENERAL] FSM and VM file

2010-03-05 Thread akp geek
Hi All - I have turned on the auto vacuum on the slave and for some reason the db is getting bloated up. The master size is only 1G and the slave is at 9.2GB now. I did cluster on couple of tables also. did any one run into this situation? Can you please help? Regards 2010/3/3 ak

Re: [GENERAL] select issue with order v8.1

2010-03-05 Thread Adrian Klaver
On Thursday 04 March 2010 2:59:45 pm Terry wrote: > On Fri, Feb 26, 2010 at 4:52 PM, Scott Marlowe wrote: > > On Fri, Feb 26, 2010 at 3:46 PM, Tom Lane wrote: > >> Terry writes: > >>> I am somewhat confused.  My app is detecting it as a serial data type > >>> but describing the table shows that

Re: [GENERAL] Xpath Index in PostgreSQL

2010-03-05 Thread Chris Roffler
Figured it out , thanks for all your help ( had missing brackets ) Here is the sql statement CREATE INDEX xml_index ON time_series USING btree (( (xpath('/AttributeList/Attributes/Attribute/Name/text()', external_attributes))[1]::text)); Thanks Chris On Fri, Mar 5, 2010 at 4:18 PM, Chr

Re: [GENERAL] Auto VACUUM

2010-03-05 Thread Joao Ferreira gmail
On Fri, 2010-03-05 at 10:03 -0500, akp geek wrote: > Hi All - > > I am still having the issue, even after I turned on the > auto vaccum. I have quick question. How do I know that auto vacuum > process is running. When I restarted my database , I got the message > auto vacuum launcher

Re: [GENERAL] Auto VACUUM

2010-03-05 Thread akp geek
Thanks for the help. Will do that. Regards On Fri, Mar 5, 2010 at 10:35 AM, Joao Ferreira gmail < joao.miguel.c.ferre...@gmail.com> wrote: > On Fri, 2010-03-05 at 10:03 -0500, akp geek wrote: > > Hi All - > > > > I am still having the issue, even after I turned on the > > auto vaccu

[GENERAL] XML performance tuning

2010-03-05 Thread Chris Roffler
Are there any guidelines for XML performance tuning ? Thanks Chris

[GENERAL] character confusion

2010-03-05 Thread Steve Crawford
Just noticed something odd with a column of type "char". According to the docs (and the way my old PG ran), the character data-type is blank-padded. I'm not seeing that on one of my current machines (8.3.8) or, perhaps I'm going blind on Friday. Was the definition of char changed? Here is what

[GENERAL] For Loop using row_data to increase performance

2010-03-05 Thread John777
Hi, Here are sample stat: - Template_product has 1,033040 rows - template_all_in_one has 93,796,400 rows I basically need to calculate the total for each article in template_all_in_one and update it to Template_product. What is the best way to improve the performance? I already have 7 indexes

[GENERAL] kernel version impact on PostgreSQL performance

2010-03-05 Thread Cyril Scetbon
Does anyone know what can be the differences between linux kernels 2.6.29 and 2.6.30 that can cause this big difference (TPS x 7 !) http://www.phoronix.com/scan.php?page=article&item=linux_2624_2633&num=2 Regards -- Cyril SCETBON -- Sent via pgsql-general mailing list (pgsql-general@postgresql.o

Re: [GENERAL] For Loop using row_data to increase performance

2010-03-05 Thread John777
here is the update section which take very long to run. ==>328001.274 ms "Index Scan using idx_template_product on template_product (cost=2729612.82..2729621.18 rows=1 width=87) (actual time=327643.885..327643.889 rows=1 loops=1)" " Index Cond: (id = 10566)" " InitPlan 1 (returns $0)" "-> Ag

[GENERAL] kernel version impact on PostgreSQL performance

2010-03-05 Thread Cyril Scetbon
Does anyone know what can be the differences between linux kernels 2.6.29 and 2.6.30 that can cause this big difference (TPS x 7 !) http://www.phoronix.com/scan.php?page=article&item=linux_2624_2633&num=2 Regards -- Cyril SCETBON -- Sent via pgsql-general mailing list (pgsql-general@postgresql.

Re: [GENERAL] need some advanced books on Postgres

2010-03-05 Thread Thomas
Good advice ,tks both of you . For database books ,I found so many good books on Oracle,some on mysql,but db2 and postgres, so few. I have to read some books on Oracle for some advanced topics,although oracle and postgres are different ,I also get some useful info from it . I hope postgres will be

[GENERAL] log_statement and syslog severity

2010-03-05 Thread G Dutton
Hello all, I've seen some rather tangential postings about means of filtering log messages, but none quite match up to (what I believe to be) my requirement, so here goes: As a means of auditing our database server, I would like to use the PostgreSQL 'log_statement' mechanism. Having set log_sta

Re: [GENERAL] kernel version impact on PostgreSQL performance

2010-03-05 Thread Scott Marlowe
On Fri, Mar 5, 2010 at 7:09 AM, Cyril Scetbon wrote: > Does anyone know what can be the differences between linux kernels 2.6.29 > and 2.6.30 that can cause this big difference (TPS x 7 !) > http://www.phoronix.com/scan.php?page=article&item=linux_2624_2633&num=2 I'm gonna guess those ones with h

Re: [GENERAL] kernel version impact on PostgreSQL performance

2010-03-05 Thread John R Pierce
Scott Marlowe wrote: On Fri, Mar 5, 2010 at 7:09 AM, Cyril Scetbon wrote: Does anyone know what can be the differences between linux kernels 2.6.29 and 2.6.30 that can cause this big difference (TPS x 7 !) http://www.phoronix.com/scan.php?page=article&item=linux_2624_2633&num=2 I'm go

Re: [GENERAL] Foreign key behavior different in a function and outside

2010-03-05 Thread Mridula Mahadevan
Richard, To answer your questions, I have a live application that is running on postgresql. We are seeing this issue on certain installations and not on others. So the code is no different in each set up. I also added the trigger to table B and then the foreign key error is thrown in all set u

Re: [GENERAL] kernel version impact on PostgreSQL performance

2010-03-05 Thread Greg Smith
Cyril Scetbon wrote: Does anyone know what can be the differences between linux kernels 2.6.29 and 2.6.30 that can cause this big difference (TPS x 7 !) http://www.phoronix.com/scan.php?page=article&item=linux_2624_2633&num=2 Discussed in detail at http://archives.postgresql.org/message-id/4b

Re: [GENERAL] Restore Data Encountered the ERROR: literal carriage return found in data Error

2010-03-05 Thread Wang, Mary Y
Rich - Thanks for explanation for ctrl+M = ascii 13 = CR.Yes. I've been using a very old version of Postgres and trying to migrate to Postgres 8.3.8. Wow! Thanks Tom! Yes. It took a long time to restore but it was worth it. Using -inserts option of pg_dump were able to restore lots of dat

Re: [GENERAL] character confusion

2010-03-05 Thread Tom Lane
Steve Crawford writes: > Just noticed something odd with a column of type "char". According to > the docs (and the way my old PG ran), the character data-type is > blank-padded. I'm not seeing that on one of my current machines (8.3.8) > or, perhaps I'm going blind on Friday. Was the definition

Re: [GENERAL] For Loop using row_data to increase performance

2010-03-05 Thread Alban Hertroys
On 5 Mar 2010, at 11:28, John777 wrote: > Hi, > > Here are sample stat: > - Template_product has 1,033040 rows > - template_all_in_one has 93,796,400 rows > > I basically need to calculate the total for each article in > template_all_in_one and update it to Template_product. > > What is the bes

Re: [GENERAL] need some advanced books on Postgres

2010-03-05 Thread Pedro Doria Meunier
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 "I hope postgres will be as popular as linux one day , :)" Where have you been all these years?!?!? Postgresql is THE database! humph! On 03/05/2010 10:01 AM, Thomas wrote: > Good advice ,tks both of you . > For database books ,I found so many good

[GENERAL] What's the best way to deal with the pk_seq sequence value after a restore (bulk loading)?

2010-03-05 Thread Wang, Mary Y
Hi All, After a restore, I got a lot errors like this one : "duplicate key value violates unique constraint "bug_pkey"". After looking at the dump file, it has CREATE SEQUENCE bug_pk_seq INCREMENT BY 1 MAXVALUE 2147483647 NO MINVALUE CACHE 1; ALTER TABLE SELECT pg_catalog.setva

Re: [GENERAL] Optimizations

2010-03-05 Thread Craig Ringer
On 5/03/2010 10:09 PM, Ogden wrote: Would searching a huge table be as fast as calculating or about the same? I'll have to run some tests on my end but I am very impressed by the speed of which PostgreSQL executes aggregate functions. I'm not sure what you're asking. Do you suggest looking

[GENERAL] 9.0 VACUUM FULL vs. ALTER TABLE?

2010-03-05 Thread Noah Misch
I understand that 9.0 will have a new implementation of VACUUM FULL that follows a rewrite strategy like CLUSTER or ALTER TABLE. What differences will remain between VACUUM FULL and a no-op ALTER TABLE that rewrites? Will there remain situations in which to prefer the latter, or will it essential