[GENERAL] COLUMNAR postgreSQL ?

2011-09-20 Thread Juan Bru
Hi, Is there any plan to develop a PostgreSQL Columnar release? I'm a researcher in the scope of Health (computer scientist, DBA background), used to work very well with PostgrSQL. Recently I'm facing analysis on 100M record tables so a columnar database could be a better option, but I w

Re: [GENERAL] COLUMNAR postgreSQL ?

2011-09-20 Thread Simon Riggs
On Tue, Sep 20, 2011 at 8:48 AM, Juan Bru wrote: > Is there any plan to develop a PostgreSQL Columnar release? > > I’m a researcher in the scope of Health (computer scientist, DBA > background), used to work very well with PostgrSQL. Recently I’m facing > analysis on 100M record tables so a colum

[GENERAL] Transaction ordering on log-shipping standby

2011-09-20 Thread Andrew Rose
I've got a question about transaction ordering in a log-shipping replication environment. Here's the setup... - A pair of PostgreSQL 9 servers in active/standby configuration, using log-shipping - A single client, using a single connection - The client commits transaction 1 - The client commits

Re: [GENERAL] COLUMNAR postgreSQL ?

2011-09-20 Thread Craig Ringer
On 09/20/2011 03:48 PM, Juan Bru wrote: Hi, Is there any plan to develop a PostgreSQL Columnar release? I'm a researcher in the scope of Health (computer scientist, DBA background), used to work very well with PostgrSQL. Recently I'm facing analysis on 100M record tables so a columnar databa

[GENERAL] cache oblivious indexes (tokudb, fractal indexes)

2011-09-20 Thread Leonardo Francalanci
Hi, trying to find how to store a large amount (>1 rows/sec) of rows in a table that  has indexes on "random values" columns, I found: http://en.wikipedia.org/wiki/TokuDB Basically, instead of using btrees (which kill insert performance for random values on large tables) they use a differ

[GENERAL] Seeing foreign key lookups in explain output

2011-09-20 Thread Vincent de Phily
Hi list, an explain analyze wish : create table t1(id serial primary key); create table t2(id serial primary key, ref integer references t1(id) on delete cascade); ...insert many rows in both tables... explain delete from t1 where id < 1; ... The explain output will tell me it

[GENERAL] not enough disk space

2011-09-20 Thread Szymon Guz
Hi, If there is not enough disk space for database during loading a lot of data (under normal db load), could the data for other databases/schemas corrupt? If yes, would that be enough to run vacuum full and reindex to make sure everything is OK with the data files, or something else? regards Szym

Re: [GENERAL] Seeing foreign key lookups in explain output

2011-09-20 Thread Marti Raudsepp
On Tue, Sep 20, 2011 at 15:35, Vincent de Phily wrote: > The explain output will tell me it's using the index on t1's id, but it tells > me nothing about the seqscan that happens on t2 (because I forgot to add an > index on t2.ref). +1 for a TODO on adding foreign key trigger time to EXPLAIN ANAL

[GENERAL] Is libpq version indifferent? I.E. can 8.3.x compiled binaries run without issue against a 9.1 backend, or are clients required to be re-compiled against the 9.1 libpq

2011-09-20 Thread Reid Thompson
I believe that there should be no issue, but am asking to be sure. Thanks, reid -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Seeing foreign key lookups in explain output

2011-09-20 Thread Marti Raudsepp
On Tue, Sep 20, 2011 at 16:12, Marti Raudsepp wrote: > On Tue, Sep 20, 2011 at 15:35, Vincent de Phily > wrote: >> The explain output will tell me it's using the index on t1's id, but it tells >> me nothing about the seqscan that happens on t2 (because I forgot to add an >> index on t2.ref). > >

Re: [GENERAL] Transaction ordering on log-shipping standby

2011-09-20 Thread Marti Raudsepp
On Tue, Sep 20, 2011 at 13:46, Andrew Rose wrote: > Or to put the question another way, is the ordering of transactions on the > active and standby servers guaranteed to be the same? Yes. The WAL serializes the order of transactions. It is applied to slaves in the same order that it's written on

Re: [GENERAL] Column Privileges: NULL instead of permission denied

2011-09-20 Thread Harald Fuchs
In article , Matthew Hawn writes: > I have a table with privileged data that is restricted using column level > permissions. I would like to have single query that returns data from > the table. If the user has permission, it should return the data but > return NULL if the user does not have p

Re: [GENERAL] Seeing foreign key lookups in explain output

2011-09-20 Thread Vincent de Phily
On Tuesday 20 September 2011 16:32:50 Marti Raudsepp wrote: > On Tue, Sep 20, 2011 at 16:12, Marti Raudsepp wrote: > > +1 for a TODO on adding foreign key trigger time to EXPLAIN ANALYZE > > output. > Sorry, that was too hasty. We already have that now in 9.0 and 9.1 > (not sure when it was introd

[GENERAL] upgrade postgres to 8.4.8, centos 5.3

2011-09-20 Thread MirrorX
hello all, i have a centos 5.3 which has postgres 8.4.4 installed from the repos. I want to upgrade to 8.4.8 but when i try to install the .bin file of 8.4.8 then it's a new installation and when i try to run yum check-update nothing new is there. any ideas? tnx in advance -- View this message in

Re: [GENERAL] Transaction ordering on log-shipping standby

2011-09-20 Thread Simon Riggs
On Tue, Sep 20, 2011 at 11:46 AM, Andrew Rose wrote: > I've got a question about transaction ordering in a log-shipping replication > environment. > > Here's the setup... > > - A pair of PostgreSQL 9 servers in active/standby configuration, using > log-shipping > - A single client, using a singl

Re: [GENERAL] upgrade postgres to 8.4.8, centos 5.3

2011-09-20 Thread Scott Marlowe
On Tue, Sep 20, 2011 at 8:30 AM, MirrorX wrote: > hello all, > i have a centos 5.3 which has postgres 8.4.4 installed from the repos. I > want to upgrade to 8.4.8 but when i try to install the .bin file of 8.4.8 > then it's a new installation and when i try to run yum check-update nothing > new is

Re: [GENERAL] Dynamic constraint names in ALTER TABLE

2011-09-20 Thread Adrian Klaver
On Monday, September 19, 2011 8:09:04 pm patrick keshishian wrote: > On Mon, Sep 19, 2011 at 6:08 PM, Adrian Klaver wrote: > > On Monday, September 19, 2011 5:10:45 pm patrick keshishian wrote: > >> Hi, > >> > >> Is there any way the .sql scripts could make use of this query to get > >> the fore

Re: [GENERAL] upgrade postgres to 8.4.8, centos 5.3

2011-09-20 Thread MirrorX
thx for your answer. do u mean something like that? -> yum list | grep *PGDG*rpm or i shouldn't search in the yum repos? -- View this message in context: http://postgresql.1045698.n5.nabble.com/upgrade-postgres-to-8-4-8-centos-5-3-tp4822762p4822823.html Sent from the PostgreSQL - general mailing

[GENERAL] extensions in 9.1

2011-09-20 Thread Seb
Hi, I'm starting to migrate to 9.1 and see that there's a new mechanism to install extensions via de "CREATE EXTENSION" command. It seems very simple and convenient, but with "CREATE EXTENSION tablefunc" I'm getting the error: ERROR: function "normal_rand" already exists with same argument type

Re: [GENERAL] upgrade postgres to 8.4.8, centos 5.3

2011-09-20 Thread Scott Marlowe
If it's in the repo, just do yum update and it should get updated. On Tue, Sep 20, 2011 at 8:49 AM, MirrorX wrote: > thx for your answer. > > do u mean something like that? -> yum list | grep *PGDG*rpm > or i shouldn't search in the yum repos? > > -- > View this message in context: > http://po

Re: [GENERAL] Seeing foreign key lookups in explain output

2011-09-20 Thread Andreas Kretschmer
Marti Raudsepp wrote: > On Tue, Sep 20, 2011 at 16:12, Marti Raudsepp wrote: > > On Tue, Sep 20, 2011 at 15:35, Vincent de Phily > > wrote: > >> The explain output will tell me it's using the index on t1's id, but it > >> tells > >> me nothing about the seqscan that happens on t2 (because I fo

Re: [GENERAL] extensions in 9.1

2011-09-20 Thread Tom Lane
Seb writes: > I'm starting to migrate to 9.1 and see that there's a new mechanism to > install extensions via de "CREATE EXTENSION" command. It seems very > simple and convenient, but with "CREATE EXTENSION tablefunc" I'm getting > the error: > ERROR: function "normal_rand" already exists with

Re: [GENERAL] extensions in 9.1

2011-09-20 Thread Sebastian P . Luque
On Tue, 20 Sep 2011 11:36:15 -0400, Tom Lane wrote: > Seb writes: >> I'm starting to migrate to 9.1 and see that there's a new mechanism >> to install extensions via de "CREATE EXTENSION" command. It seems >> very simple and convenient, but with "CREATE EXTENSION tablefunc" I'm >> getting the e

Re: [GENERAL] extensions in 9.1

2011-09-20 Thread Tom Lane
"Sebastian P. Luque" writes: > Tom Lane wrote: >> It sounds like you already have the old "unpackaged" version of that >> module installed. > How can I check if this is the case? I was getting that same error when > trying to install the adminpack onto the postgres database (as postgres > user

Re: [GENERAL] upgrade postgres to 8.4.8, centos 5.3

2011-09-20 Thread Devrim GÜNDÜZ
On Tue, 2011-09-20 at 07:49 -0700, MirrorX wrote: > > > do u mean something like that? -> yum list | grep *PGDG*rpm > or i shouldn't search in the yum repos? What is the output of: cat /etc/yum.repos.d/pgdg*|grep baseurl Regards, -- Devrim GÜNDÜZ Principal Systems Engineer @ EnterpriseDB: ht

[GENERAL] \d+ not showing TOAST table size?

2011-09-20 Thread Jon Nelson
I have a table with a fair bit of TOAST data in it. I noticed that \d+ does /not/ include that information (but pg_total_relation_size does). Is that intentional? It seems a bit misleading, insofar as "\d+" feels like it is meant to be a rough indication of the table size, but if 90% of the data is

Re: [GENERAL] \d+ not showing TOAST table size?

2011-09-20 Thread Josh Kupershmidt
On Tue, Sep 20, 2011 at 1:26 PM, Jon Nelson wrote: > I have a table with a fair bit of TOAST data in it. > I noticed that \d+ does /not/ include that information (but > pg_total_relation_size does). I assume by "\d+" you meant "\dt+" (\d+ doesn't show sizes at all). On version 9.0 and up, \dt+ us

Re: [GENERAL] \d+ not showing TOAST table size?

2011-09-20 Thread Tom Lane
Jon Nelson writes: > I have a table with a fair bit of TOAST data in it. > I noticed that \d+ does /not/ include that information (but > pg_total_relation_size does). > Is that intentional? This is changed as of (IIRC) 9.1. regards, tom lane -- Sent via pgsql-general ma

Re: [GENERAL] Dynamic constraint names in ALTER TABLE

2011-09-20 Thread patrick keshishian
On Tue, Sep 20, 2011 at 7:36 AM, Adrian Klaver wrote: > On Monday, September 19, 2011 8:09:04 pm patrick keshishian wrote: >> On Mon, Sep 19, 2011 at 6:08 PM, Adrian Klaver > wrote: >> > On Monday, September 19, 2011 5:10:45 pm patrick keshishian wrote: >> >> Hi, >> >> >> >> Is there any way the

Re: [GENERAL] \d+ not showing TOAST table size?

2011-09-20 Thread Jon Nelson
On Tue, Sep 20, 2011 at 2:09 PM, Josh Kupershmidt wrote: > On Tue, Sep 20, 2011 at 1:26 PM, Jon Nelson wrote: >> I have a table with a fair bit of TOAST data in it. >> I noticed that \d+ does /not/ include that information (but >> pg_total_relation_size does). > > I assume by "\d+" you meant "\dt

[GENERAL] Millions of largeobjects the production databases.

2011-09-20 Thread Dmitriy Igrishin
Hey Community, Just curious, is there are heavily loaded servers with databases in production with tons (millions) of largeobjects (pics, movies)? Theoretically, everything should be fine with it, but it is always interesting to know how things works in practice. Thanks! -- // Dmitriy.

[GENERAL] Replication between 64/32bit systems?

2011-09-20 Thread Hannes Erven
Hi folks, I'm planning to set up streaming replication from one master to one slave. I've read at http://www.postgresql.org/docs/9.1/static/warm-standby.html that the "hardware architecture" of both systems must be the same. Sure enough, what I'd really like to do is replicate from a Windows (or

Re: [GENERAL] Replication between 64/32bit systems?

2011-09-20 Thread Alan Hodgson
On September 20, 2011 01:26:06 PM Hannes Erven wrote: > So I'd like to ask if there is anything I could do by e.g. changing > compile-time options at the slave to get things going? > No. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription:

Re: [GENERAL] Replication between 64/32bit systems?

2011-09-20 Thread Guillaume Lelarge
On Tue, 2011-09-20 at 22:26 +0200, Hannes Erven wrote: > [...] > I'm planning to set up streaming replication from one master to one > slave. I've read at > http://www.postgresql.org/docs/9.1/static/warm-standby.html that the > "hardware architecture" of both systems must be the same. > > Sure eno

RES: [GENERAL] Replication between 64/32bit systems?

2011-09-20 Thread Edson Carlos Ericksson Richter
>From the manual, "In any case the hardware architecture must be the same — shipping from, say, a 32-bit to a 64-bit system will not work."... I don't even believe you can copy a 64bit database into 32bit machine... what makes warm standby impossible... I've tried this in the past, and give up -

Re: [GENERAL] Replication between 64/32bit systems?

2011-09-20 Thread Guillaume Lelarge
On Tue, 2011-09-20 at 22:37 +0200, Guillaume Lelarge wrote: > On Tue, 2011-09-20 at 22:26 +0200, Hannes Erven wrote: > > [...] > > I'm planning to set up streaming replication from one master to one > > slave. I've read at > > http://www.postgresql.org/docs/9.1/static/warm-standby.html that the > >

[GENERAL] pg-9.1 for fedora 15 available?

2011-09-20 Thread Stuart McGraw
I tried to use yum to install postgresql-9.1 on my Fedora 15 box by installing the yum conf file: rpm -ivh http://yum.pgrpms.org/reporpms/9.1/pgdg-fedora-9.1-3.noarch.rpm That was fine but when I then try to install postgresql, I get: http://yum.postgresql.org/9.1/fedora/fedora-15-i386/repoda

Re: [GENERAL] Replication between 64/32bit systems?

2011-09-20 Thread Chris Ernst
Hi Hannes, You can't use streaming replication, but you can use slony to replicate between different architectures. - Chris On 09/20/2011 02:26 PM, Hannes Erven wrote: > Hi folks, > > > I'm planning to set up streaming replication from one master to one > slave. I've read at > http://www.pos

Re: [GENERAL] COLUMNAR postgreSQL ?

2011-09-20 Thread Ondrej Ivanič
Hi, On 20 September 2011 18:16, Simon Riggs wrote: > It would be useful to get some balanced viewpoints on this. I see you > have Alterian experience, so if you are using both it could be > valuable info. I've never heard anyone describe the downsides of > columnar datastores, presumably there ar

Re: [GENERAL] Is libpq version indifferent? I.E. can 8.3.x compiled binaries run without issue against a 9.1 backend, or are clients required to be re-compiled against the 9.1 libpq

2011-09-20 Thread Merlin Moncure
On Tue, Sep 20, 2011 at 7:37 AM, Reid Thompson wrote: > I believe that there should be no issue, but am asking to be sure. yeah -- as long as you stick with v3 protocol supporting libpq (7.4+) you should be ok. all of the stuff that can change (binary wire format, integer/float date time) is abs

Re: [GENERAL] Column Privileges: NULL instead of permission denied

2011-09-20 Thread Matthew Hawn
> From: Stephen Frost [mailto:sfr...@snowman.net] > > * Matthew Hawn (matth...@donaanacounty.org) wrote: > > I have a table with privileged data that is restricted using column > level > > permissions. I would like to have single query that returns data > from the > > table. If the user has per

Re: [GENERAL] COLUMNAR postgreSQL ?

2011-09-20 Thread Tomas Vondra
On 21 Září 2011, 0:13, Ondrej Ivanič wrote: > Hi, > > On 20 September 2011 18:16, Simon Riggs wrote: >> It would be useful to get some balanced viewpoints on this. I see you >> have Alterian experience, so if you are using both it could be >> valuable info. I've never heard anyone describe the dow

Re: [GENERAL] COLUMNAR postgreSQL ?

2011-09-20 Thread Ondrej Ivanič
Hi, 2011/9/21 Tomas Vondra : >> Columnar store is good if: >> - you are selecting less than 60% of the total row size (our table has >> 400 cols and usual query needs 5 - 10 cols) >> - aggregates: count(*), avg(), ... > > Where did those numbers come from? What columnar database are you using? > W

Re: [GENERAL] Replication between 64/32bit systems?

2011-09-20 Thread Scott Marlowe
On Tue, Sep 20, 2011 at 2:49 PM, Chris Ernst wrote: > Hi Hannes, > > You can't use streaming replication, but you can use slony to replicate > between different architectures. But that's not all! You can also use slony to migrate from one major version to another! This is one of the things it w