[GENERAL] Replication fell out of sync

2015-03-02 Thread David Kerr
Howdy, I had an instance where a replica fell out of sync with the master. Now it's in in a state where it's unable to catch up because the master has already removed the WAL segment. (logs) Mar 2 23:10:13 db13 postgres[11099]: [3-1] user=,db=,host= LOG: streaming replication successfully co

Re: [GENERAL] Replication fell out of sync

2015-03-02 Thread David Kerr
On Mon, Mar 02, 2015 at 03:33:22PM PDT, Joshua D. Drake wrote: > > On 03/02/2015 03:25 PM, David Kerr wrote: > > > >Howdy, > > > >I had an instance where a replica fell out of sync with the master. > > > >Now it's in in a state where it's u

Re: [GENERAL] Replication fell out of sync

2015-03-02 Thread David Kerr
On Mon, Mar 02, 2015 at 04:06:02PM PDT, Adrian Klaver wrote: > On 03/02/2015 03:25 PM, David Kerr wrote: > >Howdy, > > > >I had an instance where a replica fell out of sync with the master. > > > >Now it's in in a state where it's unable to catch up bec

[GENERAL] Why does splitting $PGDATA and xlog yield a performance benefit?

2015-08-25 Thread David Kerr
Howdy All, For a very long time I've held the belief that splitting PGDATA and xlog on linux systems fairly universally gives a decent performance benefit for many common workloads. (i've seen up to 20% personally). I was under the impression that this had to do with regular fsync()'s from the

Re: [GENERAL] Why does splitting $PGDATA and xlog yield a performance benefit?

2015-08-25 Thread David Kerr
On Tue, Aug 25, 2015 at 10:16:37AM PDT, Andomar wrote: > >However, I know from experience that's not entirely true, (although it's not > >always easy to measure all aspects of your I/O bandwith). > > > >Am I missing something? > > > Two things I can think of: > > Transaction writes are entirely s

Re: [GENERAL] Why does splitting $PGDATA and xlog yield a performance benefit?

2015-08-25 Thread David Kerr
> On Aug 25, 2015, at 10:45 AM, Bill Moran wrote: > > On Tue, 25 Aug 2015 10:08:48 -0700 > David Kerr wrote: > >> Howdy All, >> >> For a very long time I've held the belief that splitting PGDATA and xlog on >> linux systems fairly universally

[GENERAL] Generate a dynamic sequence within a query

2010-10-20 Thread David Kerr
I know I've seen posts on how to do this, but i can't seem to find them. I've got a data set A, B A, C A, D [...] and so on and i'd like to be able to wite a query that would result in 1,A,B 2,A,C 3,A,D [...] PG version is 8.3. Any ideas? Thanks Dave -- Sent via pgsql-general mailing lis

Re: [GENERAL] Generate a dynamic sequence within a query

2010-10-20 Thread David Kerr
On Wed, Oct 20, 2010 at 11:28:18PM +0100, Raymond O'Donnell wrote: - On 20/10/2010 23:22, David Kerr wrote: - >I know I've seen posts on how to do this, but i can't seem to find them. - > - >I've got a data set - > - >A, B - >A, C - >A, D - >[...] - >

Re: [GENERAL] Generate a dynamic sequence within a query

2010-10-20 Thread David Kerr
On Wed, Oct 20, 2010 at 03:47:19PM -0700, DM wrote: - select generate_series(1,(select count(*) from tax)), country from tax; - - you should use braces around the sub select. - - Thanks - Deepak - Ah, great, thanks! Dave - On Wed, Oct 20, 2010 at 3:30 PM, David Kerr wrote: - - > On

Re: [GENERAL] Generate a dynamic sequence within a query

2010-10-20 Thread David Kerr
t 20, 2010 at 3:30 PM, David Kerr wrote: - - > On Wed, Oct 20, 2010 at 11:28:18PM +0100, Raymond O'Donnell wrote: - > - On 20/10/2010 23:22, David Kerr wrote: - > - >I know I've seen posts on how to do this, but i can't seem to find them. - > - > - > - >I&

Re: [GENERAL] Generate a dynamic sequence within a query

2010-10-21 Thread David Kerr
On Wed, Oct 20, 2010 at 10:32:15PM -0400, Josh Kupershmidt wrote: - On Wed, Oct 20, 2010 at 6:22 PM, David Kerr wrote: - > I know I've seen posts on how to do this, but i can't seem to find them. - > - > I've got a data set - > - > A, B - > A, C - > A, D - &

Re: [GENERAL] Generate a dynamic sequence within a query

2010-10-21 Thread David Kerr
On Wed, Oct 20, 2010 at 09:35:11PM -0700, Darren Duncan wrote: - Josh Kupershmidt wrote: - >On Wed, Oct 20, 2010 at 6:22 PM, David Kerr wrote: - >>I know I've seen posts on how to do this, but i can't seem to find them. - >> - >>I've got a data

[GENERAL] pg_hba LDAP Authentication syntax

2010-11-04 Thread David Kerr
Howdy, I was hoping someone could help me with ye olde ldap authentication syntax. I'm currently using PG 8.3.9 and an upgrade is not an option. Now, that being said, since i'm very new to LDAP i decided to use PG 9 to experiment with since it looks like it has an easier syntax. So what i've g

Re: [GENERAL] pg_hba LDAP Authentication syntax

2010-11-04 Thread David Kerr
On Thu, Nov 04, 2010 at 02:07:29PM -0700, Magnus Hagander wrote: - > - > I'm trying to translate that to the old syntax of: - >     ldap "ldap://w.x.y.z/ou=postgresql,dc=domain,dc=com;" - > - > basically, i don't know how to fit cn=admin and ldapbindpassword into that string. - - The search+bind

Re: [GENERAL] pg_hba LDAP Authentication syntax

2010-11-04 Thread David Kerr
On Thu, Nov 04, 2010 at 03:35:11PM -0700, Magnus Hagander wrote: - On Thu, Nov 4, 2010 at 15:30, David Kerr wrote: - > On Thu, Nov 04, 2010 at 02:07:29PM -0700, Magnus Hagander wrote: - > - > - > - > I'm trying to translate that to the old syntax of: - > - >  

[GENERAL] Problems Authenticating against OpenLDAP

2010-12-06 Thread David Kerr
I've recently configured Postgres (8.3) to authenticate against OpenLDAP this is my pg_hba.conf entry: host all all 0.0.0.0/0 ldap "ldap://ldapserver/dc=mydomain,dc=com;uid=;,ou=postgresql,dc=mydomain,dc=com"; Things are working fine most of the time. However, every once in a while i'm getting

Re: [GENERAL] Problems Authenticating against OpenLDAP

2010-12-06 Thread David Kerr
On Mon, Dec 06, 2010 at 07:03:59PM +0100, Rados?aw Smogura wrote: - Try with configuration parameter - conn_max_pending (number of connections waiting for processing thread) - conn_max_auth (same, but for authenticated) ok sounds good, i'll give that a shot! - If you are using anonymous auth then

[GENERAL] pg_dump: schema with OID 58698 does not exist

2011-02-08 Thread David Kerr
howdy all, I'm getting the above error in one of my dev DBs. I've read in the archives that to stop the error from happening I can just delete entries in pg_type and pg_class, however there seemed to be some community interest in doing some debugging. (mentioned in this thread: http://archiv

Re: [GENERAL] pg_dump: schema with OID 58698 does not exist

2011-02-09 Thread David Kerr
On Tue, Feb 08, 2011 at 10:16:02PM -0500, Tom Lane wrote: - David Kerr writes: - > I'm getting the above error in one of my dev DBs. - - Would you poke around in the system catalogs and find where the dangling - reference is located? Have you got any idea of how to reproduce this - fail

Re: [GENERAL] pg_dump: schema with OID 58698 does not exist

2011-02-09 Thread David Kerr
On Wed, Feb 09, 2011 at 09:42:36AM -0800, David Kerr wrote: - On Tue, Feb 08, 2011 at 10:16:02PM -0500, Tom Lane wrote: - - David Kerr writes: - - > I'm getting the above error in one of my dev DBs. - - - - Would you poke around in the system catalogs and find where the dangling - - refe

Re: [GENERAL] pg_dump: schema with OID 58698 does not exist

2011-02-09 Thread David Kerr
On Wed, Feb 09, 2011 at 02:15:06PM -0500, Tom Lane wrote: - David Kerr writes: - > Ok, I found the bad entries, 2 tables a sequence and 2 primary key indexes are associated - > with the wrong (invalid / nonexistant ) schema. - - > However, there are correct entries for those objects as

Re: [GENERAL] pg_dump: schema with OID 58698 does not exist

2011-02-11 Thread David Kerr
On 02/09/2011 11:23 AM, David Kerr wrote: On Wed, Feb 09, 2011 at 02:15:06PM -0500, Tom Lane wrote: - David Kerr writes: -> Ok, I found the bad entries, 2 tables a sequence and 2 primary key indexes are associated -> with the wrong (invalid / nonexistant ) schema. - -> However,

Re: [GENERAL] pg_dump: schema with OID 58698 does not exist

2011-02-15 Thread David Kerr
On Fri, Feb 11, 2011 at 03:17:51PM -0500, Tom Lane wrote: - David Kerr writes: - > So i removed the 5 entries from pg_class, but i still get that error - > when trying to pg_dump: - - > pg_dump: schema with OID 58698 does not exist - - > Any other ideas where i could look? - - We

Re: [GENERAL] find column name that has under score (_)

2011-02-17 Thread David Kerr
On Thu, Feb 17, 2011 at 01:55:46PM -0500, akp geek wrote: - Hi all - - - I am trying to write a query to find all the column names in - database that has a underscore in it (_) example souce_id. I know like will - not work , if where column_name like '%_%' Can you please help? - - Regar

Re: [GENERAL] Reordering a table

2011-02-22 Thread David Kerr
On Tue, Feb 22, 2011 at 04:40:36PM +, Howard Cole wrote: - Hi, - - a puzzle to solve... - - I have a table with a primary key, and a timestamp, e.g. - - idstamp - 1 2011-02-01 10:00 - 2 2011-02-01 09:00 - 3 2011-02-01 11:00 - - Now for reasons too painful to go into, I need

[GENERAL] PG9.2.3. Query hanging: SELECT count(*) FROM pg_catalog.pg_class...

2013-02-15 Thread David Kerr
Howdy! This query is coming from PgPool I believe. SELECT count(*) FROM pg_catalog.pg_class AS c WHERE c.relname = 'import_jobs' AND c.relpersistence = 'u' This is a very small database, like 10/15 tables, it's basically empty. If i run this query manually, it comes back immediatly. However

Re: [GENERAL] PG9.2.3. Query hanging: SELECT count(*) FROM pg_catalog.pg_class...

2013-02-15 Thread David Kerr
appen with jruby. I have standard ruby programs where this does not occur. - On Friday, February 15, 2013 01:58:55 PM David Kerr wrote: - > Howdy! - > - > This query is coming from PgPool I believe. - > - > SELECT count(*) FROM pg_catalog.pg_class AS c WHERE c.relname = -

Re: [GENERAL] PG9.2.3. Query hanging: SELECT count(*) FROM pg_catalog.pg_class...

2013-02-18 Thread David Kerr
On Sat, Feb 16, 2013 at 10:30:44AM -0800, Kevin Grittner wrote: - David Kerr wrote: - - > Also, if anyone else stumbles upon this, it only seems to happen with jruby. - - > I have standard ruby programs where this does not occur. - - It sounds like it is at least possible that it is the

[GENERAL] AWS and postgres issues

2013-04-08 Thread David Kerr
Howdy, I'm having a couple of problems that I believe are related to AWS and I'm wondering if anyone's seen them / overcome them. Brief background, I'm running PG 9.2.4 in a VPC on Amazon Linux. I'm also (attempting) to use PgPool for load balancing/failover. The overall problem is that it seem

Re: [GENERAL] AWS and postgres issues

2013-04-08 Thread David Kerr
On Mon, Apr 08, 2013 at 02:14:14PM -0600, Quentin Hartman wrote: - What version of pgpool are you using? - - Are there other commands you have a problem with? I would suspect that the - restart is causing the postgres server to go away, pgpool decides to - disconnect, and then it has to be manuall

Re: [GENERAL] AWS and postgres issues

2013-04-08 Thread David Kerr
On Mon, Apr 08, 2013 at 02:09:42PM -0700, David Kerr wrote: - On Mon, Apr 08, 2013 at 02:14:14PM -0600, Quentin Hartman wrote: - - What version of pgpool are you using? - - - - Are there other commands you have a problem with? I would suspect that the - - restart is causing the postgres server to

Re: [GENERAL] AWS and postgres issues

2013-04-08 Thread David Kerr
On Mon, Apr 08, 2013 at 02:59:56PM -0700, David Kerr wrote: - On Mon, Apr 08, 2013 at 02:09:42PM -0700, David Kerr wrote: - - On Mon, Apr 08, 2013 at 02:14:14PM -0600, Quentin Hartman wrote: - - - What version of pgpool are you using? - - - - - - Are there other commands you have a problem with

Re: [GENERAL] AWS and postgres issues

2013-04-08 Thread David Kerr
On Mon, Apr 08, 2013 at 04:24:45PM -0700, David Kerr wrote: - On Mon, Apr 08, 2013 at 02:59:56PM -0700, David Kerr wrote: - - On Mon, Apr 08, 2013 at 02:09:42PM -0700, David Kerr wrote: - - - On Mon, Apr 08, 2013 at 02:14:14PM -0600, Quentin Hartman wrote: - - - - What version of pgpool are you

Re: [GENERAL] AWS and postgres issues

2013-04-08 Thread David Kerr
On Apr 8, 2013, at 5:52 PM, Tatsuo Ishii wrote: >> 2013/4/9 Tatsuo Ishii : While debugging this with a coworker we figured out that pg_ctl was attaching to the tty and then it clicked that we needed to be using '-t' where I was using -T or (neither). >>> >>> Are you sure? I chec

Re: [GENERAL] LONG delete with LOTS of FK's

2013-05-16 Thread David Kerr
On Fri, May 10, 2013 at 11:01:15AM -0500, Larry Rosenman wrote: - On 2013-05-10 10:57, Tom Lane wrote: - >Larry Rosenman writes: - >On 2013-05-10 09:14, Tom Lane wrote: - >... and verify you get a cheap plan for each referencing table. - > - >We don't :( - > - >Ugh. I bet the problem is that in s

Re: [GENERAL] LONG delete with LOTS of FK's

2013-05-16 Thread David Kerr
On Thu, May 16, 2013 at 06:01:51PM -0500, Larry Rosenman wrote: - On 2013-05-16 17:52, David Kerr wrote: - >On Fri, May 10, 2013 at 11:01:15AM -0500, Larry Rosenman wrote: - >- On 2013-05-10 10:57, Tom Lane wrote: - >- >Larry Rosenman writes: - >- >On 2013-05-10 09:

Re: [GENERAL] Build RPM from Postgres Source

2013-07-15 Thread David Kerr
On Fri, Jul 12, 2013 at 02:37:19PM -0700, ktewari1 wrote: - Hi, - I need to have some different settings(like NAMEDATALEN etc.) and - that's why I'm trying to build postgres from the source and to create an rpm - to be send for install. - - Now, the build works fine but, I don't see a way to

Re: [GENERAL] About postgres scale out

2013-07-17 Thread David Kerr
On Wed, Jul 17, 2013 at 03:10:37PM +0800, Xiang Jun Wu wrote: - Hello, - - I'd like to ask a common question about scale out for postgres. - - Our current data volume is about 500GB ~ 1TB in one pg cluster(postgres 9.2). We've set up master/slave replication to keep sync. - To reach better perf

Re: [GENERAL] Amazon EC2 | Any recent developments

2009-06-15 Thread David Kerr
On Mon, Jun 15, 2009 at 11:12:32AM -0700, AJAY A wrote: - Hello All, - - I am investigating the possibility of hosting pgsql 8.3 on Amazon EC2 - & implementing a simple HA solution. My search of postgresql & amazon - cloud has produced little result. Just wondering if there has been - any recent

Re: [GENERAL] Amazon EC2 | Any recent developments

2009-06-15 Thread David Kerr
On Mon, Jun 15, 2009 at 12:11:54PM -0700, Just Someone wrote: - Hi, - - I have more than a few Postgres instances on EC2. For reliability I - use EBS, and take regular snapshots while also streaming the WAL files - to S3. So far, the few times that my machine died, I had no issue with - getting it

Re: [GENERAL] Amazon EC2 | Any recent developments

2009-06-16 Thread David Kerr
On Mon, Jun 15, 2009 at 06:53:00PM -0700, Just Someone wrote: - Hi, - - I've seen both - some unknown reason for it to die (mostly related to - the underlying hardware having issues). We also see instance failure - from time to time with advanced notice. Just like a regular machine - dies from tim

Re: [GENERAL] Switching from MySQL: ON DUPLICATE KEY UPDATE, plpgsql function

2009-06-29 Thread David Kerr
On Sat, Jun 27, 2009 at 08:23:26PM -0400, APseudoUtopia wrote: - Hey list, - - I'm migrating my site away from MySQL to PostgreSQL. So far, it's been - going great. However, there's one problem I've been having trouble - solving. - - I have a query which allows users to "Catch up" on read posts o

[GENERAL] UUID datatype question

2009-07-13 Thread David Kerr
In the docs for the uuid datatype it states: (http://www.postgresql.org/docs/8.4/static/datatype-uuid.html) PostgreSQL also accepts the following alternative forms for input: use of upper-case digits, the standard format surrounded by braces, omitting some or all hyphens, adding a hyphen after an

Re: [GENERAL] UUID datatype question

2009-07-13 Thread David Kerr
On Mon, Jul 13, 2009 at 03:28:09PM -0400, Tom Lane wrote: - David Kerr writes: - > Tried w/o escaping: - > insert into testuuid values ('{a0eebc99-9c0b4ef8-bb6d6bb9-bd380a11}'); - > ERROR: invalid input syntax for uuid: "{a0eebc99-9c0b4ef8-bb6d6bb9-bd380a11}" - -

[GENERAL] killing processes

2009-07-20 Thread David Kerr
What's the generally accepted method for killing processes that went 'all wacky' in postgres? I think i've seen in this group that kill -INT would be the way to go. I'm playing around with different options for a median function. this one got out of hand and was taking too long, so i wanted to

Re: [GENERAL] killing processes

2009-07-20 Thread David Kerr
On Mon, Jul 20, 2009 at 07:18:07PM -0400, Merlin Moncure wrote: - On Mon, Jul 20, 2009 at 6:48 PM, Scott Marlowe wrote: - > On Mon, Jul 20, 2009 at 4:44 PM, David Kerr wrote: - > What's most likely happening is that it's stuck in a tight loop that - > doesn't check for inte

Re: [GENERAL] killing processes

2009-07-21 Thread David Kerr
On Mon, Jul 20, 2009 at 11:14:22PM -0400, Tom Lane wrote: - David Kerr writes: - > But, i don't see any coded loop or way for me to insert a signal check. (I'm not much of a - > programmer) the function was just: - - > CREATE OR REPLACE FUNCTION array_median(anyarray) - >

Re: [GENERAL] killing processes

2009-07-21 Thread David Kerr
On Tue, Jul 21, 2009 at 01:13:18PM -0400, Tom Lane wrote: - David Kerr writes: - I tried it on a table with 81 random values. It took frickin' - forever, but seemed to be willing to respond to cancels anywhere - along the line. I'm not sure why you're seeing differently. Heh

[GENERAL] Looping through string constants

2009-08-12 Thread David Kerr
I'd like to loop through a group of constant string values using plpgsql The best analog i can think of would be in a shell script #!/usr/bin/ksh for a in a b c d e; do echo $a done ./a.ksh a b c d e Is there some tricky way I can make that happen in postgres? (I don't want to put the values

Re: [GENERAL] Looping through string constants

2009-08-12 Thread David Kerr
On Wed, Aug 12, 2009 at 07:10:16PM -0400, Tom Lane wrote: - David Kerr writes: - > I'd like to loop through a group of constant string values using plpgsql - > The best analog i can think of would be in a shell script - > #!/usr/bin/ksh - - > for a in a b c d e; do - - Use VA

[GENERAL] Schema diff tool?

2009-08-21 Thread David Kerr
Is there a default/standard (free) schema diff tool that's in use in the community? I'd like to be able to quickly identify new columns, data changes, new indexes, etc between 2 schema versions. (and then create an alter script for the original) We're using ERWin as our modeling tool, but it

Re: [GENERAL] Schema diff tool?

2009-08-21 Thread David Kerr
we're on v7.2.8 there's no pg specific option so we've been using ODBC as the "database" type and the alter's it generates are just ugly. Dave Boyd, Craig wrote: What version of ERwin are you using? Thanks, Craig Boyd David Kerr wrote: Is there a default/st

[GENERAL] export a schema / import as new schema

2009-08-21 Thread David Kerr
Is there an easy way, that I'm missing, where I can export a schema from database A and then rename it on load into database B? I use similar functionality in oracle all the time and it's great for development environments when you're making schema changes or updating a lot of data. You can me

Re: [GENERAL] export a schema / import as new schema

2009-08-21 Thread David Kerr
On Fri, Aug 21, 2009 at 12:00:11PM -0700, Joshua D. Drake wrote: - On Fri, 2009-08-21 at 11:56 -0700, David Kerr wrote: - > Is there an easy way, that I'm missing, where I can export a schema from - > database A and then rename it on load into database B? - - pg_dump -s foo|psql ba

Re: [GENERAL] Schema diff tool?

2009-08-21 Thread David Kerr
On Fri, Aug 21, 2009 at 01:59:43PM -0500, Boyd, Craig wrote: - We are on 7.3.0.1666. - - ODBC alter scripts do tend to be, um, ugly. - When you do the CC are restricting the objects you CC? Try to keep it - as minimal as possible. If I get some time over the weekend I will see - what I can do.

Re: [GENERAL] export a schema / import as new schema

2009-08-21 Thread David Kerr
Thanks. Yeah, if it's not free i'll just write my own if it becomes too much of a pain =) Dave Boyd, Craig wrote: Look here: http://sqlmanager.net/en/products/postgresql They aren't cheap, but they seem to work well. Thanks, Craig Boyd David Kerr wrote: On Fri, Aug 21

Re: [GENERAL] Schema diff tool?

2009-08-21 Thread David Kerr
thanks that seems to do the trick! Dave Miroslav S wrote: Some time ago, i created this tool: http://apgdiff.sourceforge.net/ Miroslav David Kerr napsal(a): Is there a default/standard (free) schema diff tool that's in use in the community? I'd like to be able to quickly id

[GENERAL] Audit Trigger puzzler

2009-08-28 Thread David Kerr
all of my tables have 4 fields edited_by edited_date created_by created_date Most of the time, my application will set the edited_by field to reflect an application username (i.e., the application logs into the database as a database user, and that's not going to be the application user) So I lo

Re: [GENERAL] Audit Trigger puzzler

2009-08-31 Thread David Kerr
On Fri, Aug 28, 2009 at 08:07:40PM +0100, Simon Riggs wrote: - - On Fri, 2009-08-28 at 08:50 -0700, David Kerr wrote: - - > so, is there a way in a trigger to know if edited_by is expressly - > being set in the update statement? it seems like if I can know that, - > then i should b

Re: [GENERAL] Audit Trigger puzzler

2009-09-03 Thread David Kerr
On Wed, Sep 02, 2009 at 11:44:20PM -0500, Adam Rich wrote: - In Oracle, the way we handle audit triggers is by using Package - Variables. We emulate some of that functionality in postgresql by - adding a custom variable to the configuration file: - - custom_variable_classes = 'mysess' - - Then

[GENERAL] SAS70 audit + postgres

2009-09-14 Thread David Kerr
anyone pass a SAS70 audit with postgres? Our security expert has a lot of concerns due to the lack of user audit logging that's provided. especally for logging superuser / DBA actions. Of course, my stance is that you need to trust your DBAs, but I don't know if SAS70 shares my belief. Thanks

Re: [GENERAL] SAS70 audit + postgres

2009-09-14 Thread David Kerr
u to setup non-superuser roles - to do other stuff, I can understand, but there are some things only - the superuser can do, and for that, you gotta trust them. - - On Mon, Sep 14, 2009 at 1:17 PM, David Kerr wrote: - > anyone pass a SAS70 audit with postgres? - > - > Our security exp

Re: [GENERAL] SAS70 audit + postgres

2009-09-14 Thread David Kerr
. - - On Mon, Sep 14, 2009 at 1:45 PM, David Kerr wrote: - > Right, I agree there are things I can do to minimize impact, - > but If SAS70 or similar comes in and says w/o superuser auditing - > we're not giving you the certification, then that still causes us a - > problem. - &g

[GENERAL] PostgreSQL + 64 bit + performance

2009-09-14 Thread David Kerr
Are there any links to benchamrks between 32 and 64 bit postgres? My oracle experience tells me that I want to go with 64 bit postgres so that i can have faster disk and memory access. Has anyone run the numbers? Thanks Dave -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org

[GENERAL] Postmaster taking 100% of the CPU

2009-10-26 Thread David Kerr
Postmaster's been spinning at 99/100% for a few hours. trying to get an idea what would have caused it. I'm on PG 8.3.5 linux. Here's the gdb output (I'm not really all that gdb savvy, so if something else would let me know) 0x08281959 in textin () (gdb) bt #0 0x08281959 in textin () #1 0x08

Re: [GENERAL] Postmaster taking 100% of the CPU

2009-10-26 Thread David Kerr
6, 2009 at 10:30:42AM -0700, David Kerr wrote: - Postmaster's been spinning at 99/100% for a few hours. - - trying to get an idea what would have caused it. - - - I'm on PG 8.3.5 linux. - - Here's the gdb output (I'm not really all that gdb savvy, so if something else woul

Re: [GENERAL] Postmaster taking 100% of the CPU

2009-10-26 Thread David Kerr
On Mon, Oct 26, 2009 at 04:38:51PM -0400, Tom Lane wrote: - David Kerr writes: - > Looks like it was a query that was running. once my developer killed it the CPU went back down. - > I'm a little surprised by that, the backend process for that developer wasn't taking up a lot

Re: [GENERAL] SQL Path in psql

2013-09-06 Thread David Kerr
On Fri, Sep 06, 2013 at 10:45:26AM -0700, David Johnston wrote: - lup wrote - >> - >> - > I wonder if this would at least get the full path on-screen for a c/p - > \! for d in $SQLPATH; do find $d -name - > - > ; done - > - > That said, I would down-vote this suggestion. I tend to put sql

Re: [GENERAL] Trouble installing psycopg2

2013-09-26 Thread David Kerr
On Thu, Sep 26, 2013 at 01:01:54PM -0400, Laura Tateosian wrote: - Hi, I'm trying to install psycopg2 on a Centos 5, 64-bit machine. I have - both 2.4 and 2.7 Python versions on this machine. I attempted to install - using - easy-install2.7 psycopg2 - - The install is not working. (I can't im

Re: [GENERAL] Trouble installing psycopg2

2013-09-26 Thread David Kerr
On Thu, Sep 26, 2013 at 02:56:14PM -0400, Augori wrote: - Thanks, for the replies Chris and David. - - Chris, I couldn't find any psycopg files under my Python installs, so I - decided to try David's advice and yum install python-psycopg2 - It reported success, but it installed it under - ../usr/l

Re: [GENERAL] oids on disk not in pg_class

2013-10-07 Thread David Kerr
On Mon, Oct 07, 2013 at 06:32:57PM -0400, Guy Rouillier wrote: - On 10/7/2013 5:58 PM, Steve Atkins wrote: - > - >On Oct 7, 2013, at 2:48 PM, Guy Rouillier - >wrote: - > - >>We have a fairly large (1 TB) database we put on all SSDs because - >>of a very high insert and update rate (38 million rows

Re: [GENERAL] PostgreSQL vs Mongo

2013-10-17 Thread David Kerr
On Wed, Oct 16, 2013 at 09:30:59AM -0600, CS DBA wrote: - All; - - One of our clients is talking about moving to Mongo for their - reporting/data mart. I suspect the real issue is the architecture of - their data mart schema, however I don't want to start pushing back if I - can't back it up.

Re: [GENERAL] Monitoring number of backends

2013-10-23 Thread David Kerr
On Tue, Oct 22, 2013 at 12:41:58PM -0500, andy wrote: - Hi all. - - My website is about to get a little more popular. I'm trying to add in - some measurements to determine an upper limit of how many concurrent - database connections I'm currently using. - - I've started running this: - - SELE

Re: [GENERAL] Monitoring number of backends

2013-10-23 Thread David Kerr
On Wed, Oct 23, 2013 at 12:11:39PM -0500, andy wrote: - On 10/23/2013 11:07 AM, David Kerr wrote: - >On Tue, Oct 22, 2013 at 12:41:58PM -0500, andy wrote: - >- Hi all. - >- - >- My website is about to get a little more popular. I'm trying to add in - >- some measurements t

[GENERAL] Calculating memory allocaiton per process

2011-04-14 Thread David Kerr
Howdy, Is there a doc somewhere that has a formula for how much memory PG backend process will use? I'm looking to get something like total_mem = max_connections * ( work_mem + temp_buffers ) // I know it's more complicated than that, which is why I'm asking =) Something similar to Table 17-2

Re: [GENERAL] Calculating memory allocaiton per process

2011-04-14 Thread David Kerr
On Thu, Apr 14, 2011 at 03:00:07PM -0400, Jerry Sievers wrote: - David Kerr writes: - - > Howdy, - > - > Is there a doc somewhere that has a formula for how much memory PG - > backend process will use? - > - > I'm looking to get something like total_mem = max_conne

[GENERAL] What's the impact of archive_command failing?

2011-10-18 Thread David Kerr
I have postgres setup for streaming replication and my slave box went down. My question is, how long can that box stay down before it causes a material impact on the master? The archive_command that I use will not archive logs while the slave is down. I know the obvious problems: * you're no

Re: [GENERAL] What's the impact of archive_command failing?

2011-10-18 Thread David Kerr
On 10/18/2011 09:44 AM, Simon Riggs wrote: On Tue, Oct 18, 2011 at 4:58 PM, David Kerr wrote: I have postgres setup for streaming replication and my slave box went down. My question is, how long can that box stay down before it causes a material impact on the master? The archive_command

[GENERAL] haproxy / pgpool / rhcs

2012-05-22 Thread David Kerr
Hello I'm implementing HA/failover for my PG nodes. I'm using PG9.0 and async replication and linux. Typical problem - if node 1 fails I want the mirror to become active and take over for the master. The solution should be able to initiate the failover of the standby and start re-directing tr

[GENERAL] select current_setting('transaction_isolation')

2012-05-29 Thread David Kerr
Howdy, I recently did a log_min_duration_statement=0 run on my app, and found ~3million copies of "select current_setting('transaction_isolation')" I'm a Java + Hibernate stack. Does anyone know if this is a Hibernate artifact? or a jdbc artifact? or something else (implicit to some query patte

[GENERAL] Calculating Replication Lag - units

2012-06-25 Thread David Kerr
Howdy, When calculating Replication lag, I know that we have to compare the pg_current_xlog_location to pg_last_xlog_receive_location, etc. but what I'm trying to figure out is what are the units that I'm left with after the calculation. (i.e., does the xlog_location imply some time value?) He

Re: [GENERAL] Calculating Replication Lag - units

2012-06-25 Thread David Kerr
On Mon, Jun 25, 2012 at 02:17:22PM -0700, Steve Crawford wrote: - On 06/25/2012 01:17 PM, David Kerr wrote: - >Howdy, - > - >When calculating Replication lag, I know that we have to compare the - >pg_current_xlog_location - >to pg_last_xlog_receive_location, etc. but what I'm

Re: [GENERAL] Calculating Replication Lag - units

2012-06-25 Thread David Kerr
On 6/25/2012 9:55 PM, Raghavendra wrote: On Tue, Jun 26, 2012 at 1:47 AM, David Kerr mailto:d...@mr-paradox.net>> wrote: Howdy, When calculating Replication lag, I know that we have to compare the pg_current_xlog_location to pg_last_xlog_receive_location, etc. but wh

Re: [GENERAL] Calculating Replication Lag - units

2012-06-26 Thread David Kerr
On 06/26/2012 05:11 AM, Stuart Bishop wrote: On Tue, Jun 26, 2012 at 6:21 AM, David Kerr wrote: On Mon, Jun 25, 2012 at 02:17:22PM -0700, Steve Crawford wrote: - On 06/25/2012 01:17 PM, David Kerr wrote: ->Howdy, -> ->When calculating Replication lag, I know that we have to co

Re: [GENERAL] Calculating Replication Lag - units

2012-06-26 Thread David Kerr
On 06/26/2012 05:11 AM, Stuart Bishop wrote: On Tue, Jun 26, 2012 at 6:21 AM, David Kerr wrote: On Mon, Jun 25, 2012 at 02:17:22PM -0700, Steve Crawford wrote: - On 06/25/2012 01:17 PM, David Kerr wrote: ->Howdy, -> ->When calculating Replication lag, I know that we have to co

Re: [GENERAL] Calculating Replication Lag - units

2012-06-26 Thread David Kerr
On Tue, Jun 26, 2012 at 09:13:44AM -0700, Steve Crawford wrote: - On 06/26/2012 08:16 AM, David Kerr wrote: - >On 06/26/2012 05:11 AM, Stuart Bishop wrote: - >>On Tue, Jun 26, 2012 at 6:21 AM, David Kerr wrote: - >>>On Mon, Jun 25, 2012 at 02:17:22PM -0700, Steve Crawford wrot

[GENERAL] UPDATE after Cancle

2010-06-23 Thread David Kerr
Howdy all - I just got this odd behavior in my system. This is PG 8.3.10 on RedHat 5.4 psql bla bla=# update blatab set blafield = replace(blafield,'XXX-1','XXX1-') where created_by = 'blauser'; Cancel request sent UPDATE 8231584 I checked and the updated did happen. autocommit is on, an

[GENERAL] Uncable to commit: transaction marked for rollback

2010-07-01 Thread David Kerr
I'm intermittantly getting this error message in a java app. using Geronimo / Hibernate / Postgres 8.3.9 javax.transaction.RollbackException: Unable to commit: transaction marked for rollback Can someone give me a scenario where this would happen? "unable to commit" makes everyone immediatly go

Re: [GENERAL] Uncable to commit: transaction marked for rollback

2010-07-01 Thread David Kerr
On 7/1/2010 11:10 AM, Tom Lane wrote: David Kerr writes: I'm intermittantly getting this error message in a java app. using Geronimo / Hibernate / Postgres 8.3.9 javax.transaction.RollbackException: Unable to commit: transaction marked for rollback You might have better luck asking

[GENERAL] constraint/rule/trigger - insert into table X where not in table Y

2010-07-14 Thread David Kerr
Howdy, I'm trying to think of the best way to handle this situation. I've got 2 tables, X and Y Table X has a field foo varchar(20) Table Y has a field bar varchar(20) I want to enforce, that if table X.foo = 'dave' then you can't insert (or update) Y.bar = 'dave' I know this is ideally done

[GENERAL] Question about Idle in TX

2010-08-03 Thread David Kerr
I know that Idle in Transactions are a problem, however I'm trying to assess how much of a problem. for example: If a java program connects to the DB and does "begin;" and then internally does a "sleep 6 days" Does that cauz any issues other than eating a connection to the database? (note, not

Re: [GENERAL] Question about Idle in TX

2010-08-03 Thread David Kerr
On Tue, Aug 03, 2010 at 03:30:46PM -0400, Greg Smith wrote: - David Kerr wrote: - >I know that "Idle in TXs" can interfere with Vaccums for example, but - >I'm not sure if that's due to them usually having some form of lock on a - >table. - > - - Locks ar

Re: [GENERAL] Question about Idle in TX

2010-08-03 Thread David Kerr
On Tue, Aug 03, 2010 at 03:49:57PM -0400, Tom Lane wrote: - David Kerr writes: - > for example: If a java program connects to the DB and does "begin;" - > and then internally does a "sleep 6 days" - - > Does that cauz any issues other than eating a connection to

Re: [GENERAL] Question about Idle in TX

2010-08-03 Thread David Kerr
On Tue, Aug 03, 2010 at 03:57:27PM -0400, Tom Lane wrote: - David Kerr writes: - > On Tue, Aug 03, 2010 at 03:49:57PM -0400, Tom Lane wrote: - > - In recent versions of PG, no. Before about 8.3 it was a Really Bad Idea, - > - because the open transaction would prevent VACUUM from r

Re: [GENERAL] Question about Idle in TX

2010-08-06 Thread David Kerr
On Tue, Aug 03, 2010 at 03:57:27PM -0400, Tom Lane wrote: - David Kerr writes: - > On Tue, Aug 03, 2010 at 03:49:57PM -0400, Tom Lane wrote: - > - In recent versions of PG, no. Before about 8.3 it was a Really Bad Idea, - > - because the open transaction would prevent VACUUM from r

[GENERAL] Centralized User Management Tool?

2010-09-29 Thread David Kerr
Howdy, Does anyone know of any tools or methods to handle centralized user management within postgres? I've got about 20 DB servers (and growing) each requiring a different number and level of user access (think dev, qa, staging, production, etc.) Corporate security guidelines state that all

Re: [GENERAL] Centralized User Management Tool?

2010-09-29 Thread David Kerr
On Wed, Sep 29, 2010 at 02:23:14PM -0700, Joshua D. Drake wrote: - > Howdy, - > - > Does anyone know of any tools or methods to handle centralized user management within postgres? - > - > I've got about 20 DB servers (and growing) each requiring a different number and level of user access - >

[GENERAL] Postgres Clustering Options

2009-11-11 Thread David Kerr
I'm trying to meet a very high uptime requirement in a high performance environment. to do this we will need to have some form of cluster for our databases What I plan on doing is: Postgres installed on a Cluster configured in active/passive (both pointing to the same SAN (If PG or the OS fail

Re: [GENERAL] Postgres Clustering Options

2009-11-11 Thread David Kerr
On Wed, Nov 11, 2009 at 09:40:21AM -0800, John R Pierce wrote: - David Kerr wrote: - >Does anyone have expereince with this or a similar setup that they could - >share with me? - > - - thats your classic database cluster.the reason you don't see - much of that in onli

Re: [GENERAL] Postgres Clustering Options

2009-11-11 Thread David Kerr
On Wed, Nov 11, 2009 at 01:11:52PM -0500, Greg Smith wrote: - David Kerr wrote: - >Postgres installed on a Cluster configured in active/passive (both - >pointing to the same SAN - >(If PG or the OS fails we trigger a failover to the passive node) - >Log shipping between that cluster

  1   2   >