Re: [GENERAL] Memory issues

2012-09-27 Thread Andres Freund
On Monday, September 24, 2012 08:45:06 AM Shiran Kleiderman wrote: > Hi, > I'm using and Amazon ec2 instance with the following spec and the > application that I'm running uses a postgres DB 9.1. > The app has 3 main cron jobs. > > *Ubuntu 12, High-Memory Extra Large Instance > 17.1 GB of memory >

Re: [GENERAL] idle in transaction query makes server unresponsive

2012-09-27 Thread Albe Laurenz
Scot Kreienkamp wrote: >> You could try to "strace" the postmaster during a connection attempt >> and see what happens. Maybe that helps to spot the place where >> things go wrong. > [Scot Kreienkamp] > I'm willing to give it a try, but I've never done it before. What do I need to do? "man stra

Re: [GENERAL] idle in transaction query makes server unresponsive

2012-09-27 Thread Chris Travers
If it is truly idle in a transaction, maybe it has locks that are holding up other transactions? Locks are usually held until commit time, except advisory locks iirc but those have to be explicitly checked, so if you don't know if you are using them you probably aren't. Long-running transactions

Re: [GENERAL] idle in transaction query makes server unresponsive

2012-09-27 Thread Albe Laurenz
Chris Travers wrote: > If it is truly idle in a transaction, maybe it has locks that are holding up other transactions? > > Locks are usually held until commit time, except advisory locks iirc but those have to be explicitly > checked, so if you don't know if you are using them you probably aren't

Re: [GENERAL] Re: Need help in reclaiming disk space by deleting the selected records

2012-09-27 Thread Albe Laurenz
Yelai, Ramkumar wrote: > 1.Do I need run REINDEX to reduce space or auto vacuum will handle re indexing? Autovacuum will not rebuild the index as REINDEX does. It will only free index entries tht can be reused later. > 2.Cluster, Re index and Vacuum full locks the table, Hence do we need

Re: [GENERAL] [PERFORM] Inaccurate Explain Cost

2012-09-27 Thread Matthias
Am 27.09.2012, 02:04 Uhr, schrieb Jeff Janes : On Wed, Sep 26, 2012 at 1:21 PM, hubert depesz lubaczewski wrote: On Wed, Sep 26, 2012 at 02:38:09PM -0400, Robert Sosinski wrote: The first query shows a cost of 190,169.55 and runs in 199,806.951 ms. When I disable nested loop, I get a cost of

Re: [GENERAL] unc paths, like and backslashes on 8.4

2012-09-27 Thread Albe Laurenz
Chris Curvey wrote: > 1) Why do I get a warning when doubling a backslash? > 2) What is the meaning of "E" syntax (E'fs1\\bar')? > 3) If I have backslashes in my table, how can I get them back out? > 4) I'd like to run an update to change the value '\\fs1\bar' to \\fs1\foo\bar'. What incantati

Re: [GENERAL] Linux PowerPC 64bits issue

2012-09-27 Thread Leonardo M . Ramé
On 2012-09-27 11:51:46 +0800, a...@hsk.hk wrote: > Hi, > > Could you provide the steps and commands you used to compile 9.1? > > I want to reproduce your case in my machine > > Regards > Arthur > Yes, I downloaded postgresql-9.1.5.tar.gz from the PostgreSql web site, then did this: tar xvfz p

Re: [GENERAL] problem with recreating database with export

2012-09-27 Thread Adrian Klaver
On 09/26/2012 08:44 PM, Dennis Gearon wrote: It turns out that I had made the export from psql, a text based export. I just do not see how you can be exporting schema definitions from within psql. I still say pg_dump is involved somewhere. So I read that it was actually needing to be impo

Re: [GENERAL] Linux PowerPC 64bits issue

2012-09-27 Thread a...@hsk.hk
Hi, I have tried to compile it in my local machine, I could not reproduce the issue yet. Does anyone else have idea what the reason would be? Would the issue come from the config file? Regards Arthur On 27 Sep 2012, at 7:46 PM, Leonardo M. Ramé wrote: > On 2012-09-27 11:51:46 +0800, a...@

Re: [GENERAL] Linux PowerPC 64bits issue

2012-09-27 Thread Leonardo M . Ramé
On 2012-09-27 21:44:21 +0800, a...@hsk.hk wrote: > Hi, > > I have tried to compile it in my local machine, I could not reproduce the > issue yet. > > Does anyone else have idea what the reason would be? Would the issue come > from the config file? > > Regards > Arthur > > On 27 Sep 2012, a

Re: [GENERAL] Linux PowerPC 64bits issue

2012-09-27 Thread Adrian Klaver
On 09/27/2012 04:46 AM, Leonardo M. Ramé wrote: On 2012-09-27 11:51:46 +0800, a...@hsk.hk wrote: Hi, Could you provide the steps and commands you used to compile 9.1? I want to reproduce your case in my machine Regards Arthur Yes, I downloaded postgresql-9.1.5.tar.gz from the PostgreSql we

Re: [GENERAL] Linux PowerPC 64bits issue

2012-09-27 Thread Leonardo M . Ramé
On 2012-09-27 06:53:57 -0700, Adrian Klaver wrote: > On 09/27/2012 04:46 AM, Leonardo M. Ramé wrote: > >On 2012-09-27 11:51:46 +0800, a...@hsk.hk wrote: > >>Hi, > >> > >>Could you provide the steps and commands you used to compile 9.1? > >> > >>I want to reproduce your case in my machine > >> > >>R

Re: [GENERAL] Linux PowerPC 64bits issue

2012-09-27 Thread Leonardo M . Ramé
On 2012-09-27 06:53:57 -0700, Adrian Klaver wrote: > On 09/27/2012 04:46 AM, Leonardo M. Ramé wrote: > >On 2012-09-27 11:51:46 +0800, a...@hsk.hk wrote: > >>Hi, > >> > >>Could you provide the steps and commands you used to compile 9.1? > >> > >>I want to reproduce your case in my machine > >> > >>R

Re: [GENERAL] Linux PowerPC 64bits issue

2012-09-27 Thread Leonardo M . Ramé
On 2012-09-27 11:02:48 -0300, Leonardo M. Ramé wrote: > On 2012-09-27 06:53:57 -0700, Adrian Klaver wrote: > > On 09/27/2012 04:46 AM, Leonardo M. Ramé wrote: > > >On 2012-09-27 11:51:46 +0800, a...@hsk.hk wrote: > > >>Hi, > > >> > > >>Could you provide the steps and commands you used to compile 9.

Re: [GENERAL] trigger and plpgsq help needed

2012-09-27 Thread SUNDAY A. OLUTAYO
RobR, I have tried it 'IF FOUND' but not getting the desired result Thanks, Sunday Olutayo - Original Message - From: "Rob Richardson" To: pgsql-general@postgresql.org Sent: Wednesday, September 26, 2012 7:14:46 PM Subject: Re: [GENERAL] trigger and plpgsq help needed Why

Re: [GENERAL] trigger and plpgsq help needed

2012-09-27 Thread SUNDAY A. OLUTAYO
I have tried "IF NOT FOUND THEN" but not getting the desired result Thanks, Sunday Olutayo Sadeeb Technologies Ltd 7 Mayegun Street, Ojo Lagos State, Nigeria. Tel: +234 1 7404524 D/L: +234 1 8169922 Cell: +234 8054600338, 234 8096441688 Fax: +234 8054895664 mail: olut...@sadeeb.com

Re: [GENERAL] Linux PowerPC 64bits issue

2012-09-27 Thread Leonardo M . Ramé
On 2012-09-27 11:21:04 -0300, Leonardo M. Ramé wrote: > On 2012-09-27 11:02:48 -0300, Leonardo M. Ramé wrote: > > On 2012-09-27 06:53:57 -0700, Adrian Klaver wrote: > > > On 09/27/2012 04:46 AM, Leonardo M. Ramé wrote: > > > >On 2012-09-27 11:51:46 +0800, a...@hsk.hk wrote: > > > >>Hi, > > > >> > >

Re: [GENERAL] problem with recreating database with export

2012-09-27 Thread Dennis Gearon
To anyone reading this in the future, if you have problems importing a plain text database export, it is usually impossible to do: psql -d some_dbase -f the_backup.sql. I don't know why. What works is doing 'cd ./the_files_directory', going INTO psql command line, then issuing '\i the_backup.sq

Re: [GENERAL] problem with recreating database with export

2012-09-27 Thread Alban Hertroys
On 27 September 2012 16:55, Dennis Gearon wrote: > > To anyone reading this in the future, if you have problems importing a plain > text database export, it is usually impossible to do: > psql -d some_dbase -f the_backup.sql. I don't know why. Looks like you forgot -U postgres -- If you can't

Re: [GENERAL] problem with recreating database with export

2012-09-27 Thread Dennis Gearon
Not needed if you are logged in as user postgres in your OS when you enter psql. At least, with the hba_conf file the way it is stock. But a good point, though. I wonder if I would then have to know the DATABASE password for postgres if I wasn't user postgres in the OS? Dennis Gearon Never,

Re: [GENERAL] trigger and plpgsq help needed

2012-09-27 Thread SUNDAY A. OLUTAYO
Thanks you all, " IF last_id IS NULL THEN " eventually work Thanks, Sunday Olutayo Sadeeb Technologies Ltd - Original Message - From: "SUNDAY A. OLUTAYO" To: "Rob Richardson" Cc: pgsql-general@postgresql.org Sent: Thursday, September 27, 2012 2:04:46 PM Subject: Re: [GENER

Re: [GENERAL] unc paths, like and backslashes on 8.4

2012-09-27 Thread Chris Curvey
Many thanks to David and Albe for their kind assistance. I've looked at the docs and run some experiments, and this is what I found. I'm going to answer my own questions in a slightly different order, because it seems to make the explanation more logical. Note that the rules appear to be differe

Re: [GENERAL] unc paths, like and backslashes on 8.4

2012-09-27 Thread David Johnston
From: pgsql-general-ow...@postgresql.org [mailto:pgsql-general-ow...@postgresql.org] On Behalf Of Chris Curvey Sent: Thursday, September 27, 2012 1:44 PM To: pgsql Subject: Re: [GENERAL] unc paths, like and backslashes on 8.4 Many thanks to David and Albe for their kind assistance. I've looked

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-27 Thread Ryan Kelly
On Thu, Sep 27, 2012 at 08:51:31AM +1000, Ondrej Ivanič wrote: > Hi, > > On 26 September 2012 21:50, Ryan Kelly wrote: > > The size of our database is growing rather rapidly. We're concerned > > about how well Postgres will scale for OLAP-style queries over terabytes > > of data. Googling around

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-27 Thread Ryan Kelly
On Thu, Sep 27, 2012 at 08:58:05AM +1200, Gavin Flower wrote: > On 26/09/12 23:50, Ryan Kelly wrote: > >Hi: > > > >The size of our database is growing rather rapidly. We're concerned > >about how well Postgres will scale for OLAP-style queries over terabytes > >of data. Googling around doesn't yiel

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-27 Thread Ryan Kelly
On Wed, Sep 26, 2012 at 09:15:35PM -0400, Stephen Frost wrote: > All, > > * Scott Marlowe (scott.marl...@gmail.com) wrote: > > If you want fastish OLAP on postgres you need to do several things. > [...] > > All good suggestions. > > I'd recommend looking at ROLAP approaches and doing aggregation

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-27 Thread Ryan Kelly
On Wed, Sep 26, 2012 at 03:18:16PM -0600, Scott Marlowe wrote: > On Wed, Sep 26, 2012 at 5:50 AM, Ryan Kelly wrote: > > Hi: > > > > The size of our database is growing rather rapidly. We're concerned > > about how well Postgres will scale for OLAP-style queries over terabytes > > of data. Googling

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-27 Thread Rob Sargent
On 09/27/2012 12:50 PM, Ryan Kelly wrote: What do you mean by "fewer faster cores"? Wouldn't "more faster cores" be better? I believe his point is core does not equal cpu. Too often I've watched cpu performance meters with one core pegged and the other(s) idle, since really it's one cpu. I s

Re: [GENERAL] problem with recreating database with export

2012-09-27 Thread Raymond O'Donnell
On 27/09/2012 15:55, Dennis Gearon wrote: > > To anyone reading this in the future, if you have problems importing a > plain text database export, it is usually impossible to do: > psql -d some_dbase -f the_backup.sql. I don't know why. What works is I think that's a bit of an over-generalisation

Re: [GENERAL] problem with recreating database with export

2012-09-27 Thread Dennis Gearon
The only thing that I can offer is that it works from inside psql as user postgre but NOT from invoking postgres using -f filename from the commas line as user postgre. I have to admit that I did not use -U as OS user postgres, but that shouldn't be necessary with a stock gnarled_conf file. Th

[GENERAL] XML indexing

2012-09-27 Thread antony . carvalho
Hi all, Im trying to use the xpath funtion to get xml text nodes with efficiency, than i created an index like :=#create index doc_idx on testxml using btree (((xpath('/book/id/text()', doc))[1]::text));But the index is used just when i want xpath('/book/id/text()', doc). I want to get any text no

Re: [GENERAL] problem with recreating database with export

2012-09-27 Thread Adrian Klaver
On 09/27/2012 07:55 AM, Dennis Gearon wrote: To anyone reading this in the future, if you have problems importing a plain text database export, it is usually impossible to do: psql -d some_dbase -f the_backup.sql. I don't know why. What works is doing 'cd ./the_files_directory', going INTO psql

Re: [GENERAL] problem with recreating database with export

2012-09-27 Thread Leif Biberg Kristensen
Torsdag 27. september 2012 16.55.15 skrev Dennis Gearon : > > To anyone reading this in the future, if you have problems importing a > plain text database export, it is usually impossible to do: > psql -d some_dbase -f the_backup.sql. I don't know why. What works is doing > 'cd ./the_files_direct

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-27 Thread Ondrej Ivanič
Hi, On 28 September 2012 04:34, Ryan Kelly wrote: > On Thu, Sep 27, 2012 at 08:51:31AM +1000, Ondrej Ivanič wrote: >> - aggregation job ran every 15 minutes and completed under 2 minutes: >> 5mil rows -> aggregation -> 56 tables > 5mil overall, or matching your aggregation query? And is that the

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-27 Thread Scott Marlowe
On Thu, Sep 27, 2012 at 12:50 PM, Ryan Kelly wrote: > On Wed, Sep 26, 2012 at 03:18:16PM -0600, Scott Marlowe wrote: >> On Wed, Sep 26, 2012 at 5:50 AM, Ryan Kelly wrote: >> > Hi: >> > >> > The size of our database is growing rather rapidly. We're concerned >> > about how well Postgres will scale

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-27 Thread Chris Travers
On Thu, Sep 27, 2012 at 11:34 AM, Ryan Kelly wrote: > > > > At this time I would try: > > - Postgres-XC > From what I understand, more of a write-scaleable-oriented solution. We > mostly will need read scalability. I also don't think it really handles > redundancy. > >From my understanding it ge

[GENERAL] replicate or multi-master for 9.1 or 9.2

2012-09-27 Thread Jon Hancock
We have a new pg system on 9.1, just launched inside China. We now know we may need to run a replicate, with some writes to it outside China. Would like some advice. Here are parameters: 1 - Our data center is in Beijing. If we have a replicate in a data center in California, we can expec

Re: [GENERAL] replicate or multi-master for 9.1 or 9.2

2012-09-27 Thread John R Pierce
On 09/27/12 9:37 PM, Jon Hancock wrote: We have a new pg system on 9.1, just launched inside China. We now know we may need to run a replicate, with some writes to it outside China. Would like some advice. Here are parameters: 1 - Our data center is in Beijing. If we have a replicate in a

Re: [GENERAL] replicate or multi-master for 9.1 or 9.2

2012-09-27 Thread Chris Travers
On Thu, Sep 27, 2012 at 9:37 PM, Jon Hancock wrote: > We have a new pg system on 9.1, just launched inside China. We now know > we may need to run a replicate, with some writes to it outside China. > Would like some advice. Here are parameters: > > 1 - Our data center is in Beijing. If we hav