Re: [GENERAL] At what point does a big table start becoming too big?

2012-08-24 Thread Gavin Flower
On 23/08/12 11:06, Nick wrote: I have a table with 40 million rows and haven't had any performance issues yet. Are there any rules of thumb as to when a table starts getting too big? For example, maybe if the index size is 6x the amount of ram, if the table is 10% of total disk space, etc?

Re: [GENERAL] Which postgresql should i choose to migrate from 8.3 ? 8.4 or 9.1?

2012-08-28 Thread Gavin Flower
On 29/08/12 04:52, Ing.Edmundo.Robles.Lopez wrote: Hi! We are using postgresql 8.3 in my work, and the need to migrate to a newer version became urgent :) I've been reading the release notes for versions 8.4 and 9.1, but is not clear to me which problems I can have with version 8.4 or 9.1 fro

Re: [GENERAL] "Need some information about postgresql products and community"

2012-08-28 Thread Gavin Flower
On 29/08/12 02:29, mithun wrote: Dear Sir, We are gathering information regarding PostgreSQL open source product quality and its community. Can you kindly help me to find following data. 1.Number of releases happened since last 12 months along with its version numbers. 2.Number of Bugs

Re: [GENERAL] "Too far out of the mainstream"

2012-09-03 Thread Gavin Flower
On 04/09/12 10:38, Geert Mak wrote: I have been looking into heroku lately, they run on PostgreSQL - https://postgres.heroku.com/postgres "PostgreSQL is the database of choice for reliable web-applications." Is what they say on that page, not mincing words are they? Cheers, Gavin -- Sen

Re: [GENERAL] "Too far out of the mainstream"

2012-09-04 Thread Gavin Flower
On 05/09/12 05:35, Scott Marlowe wrote: On Tue, Sep 4, 2012 at 11:28 AM, Mike Christensen wrote: On Mon, Sep 3, 2012 at 3:38 PM, Geert Mak wrote: I have been looking into heroku lately, they run on PostgreSQL - https://postgres.heroku.com/postgres Went out to lunch with a guy who worked for

Re: [GENERAL] "Too far out of the mainstream"

2012-09-04 Thread Gavin Flower
On 05/09/12 08:38, Scott Marlowe wrote: On Tue, Sep 4, 2012 at 2:03 PM, Gavin Flower wrote: On 05/09/12 05:35, Scott Marlowe wrote: I have read to emails to one of the postgresql lists, where people in companies with 1000's of databases had power failures and only the postgresql data

Re: [GENERAL] Add a check an a array column

2012-09-09 Thread Gavin Flower
On 09/09/12 23:12, vdg wrote: Thanks for your help. Before posting, I had tried something like check ((ALL(i) >= 0) AND (ALL(i) <= 1024 ))); but i got syntax errors. It seems the first ALL() was not recognized. Could someone give me documentation hints on this behaviour ? vdg On Saturday,

Re: [GENERAL] log_destination = csvlog

2012-09-17 Thread Gavin Flower
On 18/09/12 08:45, Edson Richter wrote: Em 17/09/2012 16:32, Ryan Kelly escreveu: On Mon, Sep 17, 2012 at 04:20:14PM -0300, Edson Richter wrote: Dear all, I've started collecting log information in CSV format, but I need a way to customize it. Problem is that I'm collecting slow statements, an

Re: [GENERAL] Change key primary for key foreign

2012-09-19 Thread Gavin Flower
On 19/09/12 19:40, Albe Laurenz wrote: Guilherme Rodrigues wrote: I created one table so: CREATE TABLE clima ( city char(80), cprc int, ); And have other table so: CREATE TABLE city ( namechar(80), other_thing int, ); These SQL statements have synt

Re: [GENERAL] Difference between ON and WHERE in JOINs

2012-09-19 Thread Gavin Flower
On 20/09/12 03:08, Merlin Moncure wrote: On Tue, Sep 18, 2012 at 7:47 PM, David Johnston wrote: >On Sep 18, 2012, at 20:21, Jean-Christophe Boggio wrote: > >>I'm looking for an article that explains the difference between these constructs IN POSTGRESQL (the rules seem to differ from one DB

Re: [GENERAL] PostgreSQL, OLAP, and Large Clusters

2012-09-26 Thread Gavin Flower
On 26/09/12 23:50, Ryan Kelly wrote: Hi: The size of our database is growing rather rapidly. We're concerned about how well Postgres will scale for OLAP-style queries over terabytes of data. Googling around doesn't yield great results for vanilla Postgres in this application, but generally links

Re: [GENERAL] Help estimating database and WAL size

2012-10-08 Thread Gavin Flower
On 09/10/12 09:39, Daniel Serodio (lists) wrote: We are preparing a PostgreSQL database for production usage and we need to estimate the storage size for this database. We're a team of developers with low expertise on database administration, so we are doing research, reading manuals and using

Re: [GENERAL] Index only scan

2012-10-10 Thread Gavin Flower
On 11/10/12 01:03, Lars Helge Øverland wrote: Hi all, first of all thanks for the great new "index only scan" feature in 9.2. We have managed to adapt our app (dhis2.org) to take advantage of it and it really speeds up several queries significantly. We are now in the process of designing a new

Re: [GENERAL] Index only scan

2012-10-10 Thread Gavin Flower
On 11/10/12 12:41, Tom Lane wrote: Gavin Flower writes: On 11/10/12 01:03, Lars Helge Øverland wrote: My question is: Would it be feasible and/or possible to implement index only scans in a way that it could take advantage of several, single-column indexes? For example, a query spanning

Re: [GENERAL] moving from MySQL to pgsql

2012-10-11 Thread Gavin Flower
On 12/10/12 04:39, Merlin Moncure wrote: On Thu, Oct 11, 2012 at 4:44 AM, Vineet Deodhar wrote: Thanks all for your replies. This is my first experience with postgres mailing list. Hats Off to the active community of pgsql. This has definitely raised my confidence level with postgres. thanks.

Re: [GENERAL] Postgres DB Migration from 8.3 to 9.1

2012-10-11 Thread Gavin Flower
On 12/10/12 15:15, Vishalakshi Navaneethakrishnan wrote: Hi Friends, We have our production environment database server in Postgres 8.3 version. we have planned to upgrade to lastest version 9.1. Dump from 8.3 and restore in Postgres 9.1 takes more than 5 hours. Any other quick method to upg

Re: [GENERAL] PostgresQL intallation error

2012-10-27 Thread Gavin Flower
On 27/10/12 23:30, Raul Feliu wrote: I have windows vista. I tried to run the installer in admin mode and I disabled UAC. Still having the same problem. Any other help will be wellcome :) Thanks again, and thanks Xiong He. --

Re: [GENERAL] Great site for comparing databases (or anything else)

2012-10-27 Thread Gavin Flower
On 28/10/12 12:00, Stephen Cook wrote: On 10/27/2012 5:18 PM, Mike Christensen wrote: Just came across this one: http://hammerprinciple.com/databases/items/mysql/postgresql mySQL is great for embedding in applications though? Have they not read Oracle's license? Does it say anywhere on tha

Re: [GENERAL] Great site for comparing databases (or anything else)

2012-10-27 Thread Gavin Flower
On 28/10/12 12:29, Leif Biberg Kristensen wrote: Søndag 28. oktober 2012 01.17.45 skrev Gavin Flower : Also note that for features that are obviously complicated or advanced, Postgres tends to a lot better than MySQL. It's like comparing BASIC to C. BASIC has a low threshold, but you

Re: [GENERAL] Great site for comparing databases (or anything else)

2012-10-27 Thread Gavin Flower
On 28/10/12 16:52, Edson Richter wrote: Em 28/10/2012 01:35, Gavin Flower escreveu: On 28/10/12 12:29, Leif Biberg Kristensen wrote: Søndag 28. oktober 2012 01.17.45 skrev Gavin Flower : Also note that for features that are obviously complicated or advanced, Postgres tends to a lot better

Re: [GENERAL] Server to run Postgresql

2012-11-03 Thread Gavin Flower
On 04/11/12 12:08, Bob Pawley wrote: Hi I have an unused computer which I am considering turning into a server to run my Postgresql database. Is this even possible to do? If so, can someone suggest an open source server that is relatively easy to set up? Windows based would be ideal. Bob If y

Re: [GENERAL] [BUGS] Prepared Statement Name Truncation

2012-11-17 Thread Gavin Flower
On 18/11/12 16:49, Greg Sabino Mullane wrote: -BEGIN PGP SIGNED MESSAGE- Hash: RIPEMD160 NOTICE: identifier "this_is_a_really_long_identifier_for_a_prepared_statement_name_ok" will be truncated to "this_is_a_really_long_identifier_for_a_prepared_statement_name_" PREPARE ... The ORM

Re: [GENERAL] [BUGS] Prepared Statement Name Truncation

2012-11-17 Thread Gavin Flower
On 18/11/12 17:10, Phil Sorber wrote: On Nov 17, 2012 11:06 PM, "Gavin Flower" mailto:gavinflo...@archidevsys.co.nz>> wrote: > > On 18/11/12 16:49, Greg Sabino Mullane wrote: >> >> -BEGIN PGP SIGNED MESSAGE- >> Hash:

Re: [GENERAL] High SYS CPU - need advise

2012-11-20 Thread Gavin Flower
On 21/11/12 11:41, Shaun Thomas wrote: On 11/20/2012 04:35 PM, Jeff Janes wrote: Atomic update commit failure in the meatware :) Ha. What's actually funny is that one of the affected machines started *swapping* earlier today. With 15GB free, and 12GB of inactive cache, and vm.swappiness se

Re: [GENERAL] High SYS CPU - need advise

2012-11-24 Thread Gavin Flower
On 25/11/12 09:30, Kevin Grittner wrote: Vlad wrote: it's session mode and the pool size is 1200 (cause I need to grantee that in the worst case we have enough slots for all possible clients), We found that the real-world production performance of a web application servicing millions of we hit

Re: [GENERAL] High SYS CPU - need advise

2012-11-24 Thread Gavin Flower
On 25/11/12 11:11, Kevin Grittner wrote: Gavin Flower wrote: We found that the real-world production performance of a web application servicing millions of we hits per day with thousands of concurrent users improved when we reconfigured our database connection pool to be about 35 instead of 55

Re: [GENERAL] Correlation in pg_stats

2012-11-27 Thread Gavin Flower
On 27/11/12 14:23, classical_89 wrote: Thanks , i just want to get a correlation of near 0 to understand exactly what correlation , i quite ambiguity about this concept . / Statistical correlation between physical row ordering and logical ordering of the column values. This ranges from -1 to +1.

Re: [GENERAL] youtube video on pgsql integrity

2012-11-29 Thread Gavin Flower
On 30/11/12 04:30, Chris Angelico wrote: On Fri, Nov 30, 2012 at 2:00 AM, Ray Stell wrote: On Nov 29, 2012, at 9:27 AM, Kevin Grittner wrote: is everything shown there really the behavior of the MySQL database itself? Good question. I intend to install mysql one day to explore, but just can'

Re: [GENERAL] Which is faster: char(14) or varchar(14)

2012-12-04 Thread Gavin Flower
On 05/12/12 06:06, Edson Richter wrote: Em 04/12/2012 14:59, hari.fu...@gmail.com escreveu: Edson Richter writes: In this specific case, the full length (14) is mandatory... so seems there is no loss or gain. Also, I see all varchar(...) created are by default "storage = EXTENDED" (from "Pg A

Re: [GENERAL] large database

2012-12-11 Thread Gavin Flower
On 11/12/12 23:25, Chris Angelico wrote: On Tue, Dec 11, 2012 at 7:26 AM, Mihai Popa wrote: Second, where should I deploy it? The cloud or a dedicated box? Forget cloud. For similar money, you can get dedicated hosting with much more reliable performance. We've been looking at places to deploy

Re: [GENERAL] Default timezone changes in 9.1

2012-12-15 Thread Gavin Flower
On 16/12/12 16:07, Terence Ferraro wrote: We recently began upgrading our clients' servers from 9.0 -> 9.2. After a few deployments and a little digging we noticed that 9.0 -> 9.1 broke the use of no timezone set within postgresql.conf. That is, not setting the option was now defaulting to GMT

Re: [GENERAL] Default timezone changes in 9.1

2012-12-15 Thread Gavin Flower
, but would you really want to walk around and have all of your clocks read 1 PM (GMT)? :) T.J. On Sat, Dec 15, 2012 at 10:35 PM, Gavin Flower mailto:gavinflo...@archidevsys.co.nz>> wrote: On 16/12/12 16:07, Terence Ferraro wrote: We recently began upgrading our clients' s

Re: [GENERAL] Default timezone changes in 9.1

2012-12-15 Thread Gavin Flower
On 16/12/12 18:23, Terence Ferraro wrote: On Sat, Dec 15, 2012 at 11:54 PM, Gavin Flower mailto:gavinflo...@archidevsys.co.nz>> wrote: Please do not top post, see end of email for rest of reply... (Bottom posting is the convention here, so people can see the context

Re: [GENERAL] New Zealand Postgis DBA job vacancy

2012-12-25 Thread Gavin Flower
On 25/12/12 09:46, pcr...@pcreso.com wrote: Mat be of interest to someone here... http://careers.eroad.co.nz/vacancies/showVacancy/11 Brent Wood I know some people in Auckland who do PostgreSQL, I've emailed them about it. Curiously, EROAD's head office is about an hours walk from where I l

Re: [GENERAL] New Zealand Postgis DBA job vacancy

2012-12-26 Thread Gavin Flower
Please do not top post! See my reply below On 27/12/12 03:48, Martin Gainty wrote: Gavin BTW: Americans dont walk anywhere ..we drive our 2 gallons to the mile Hummers everywhere we go (so Im hoping that gas is cheap there) I dont know anything about New Zealand but can one live on Sout

Re: [GENERAL] New Zealand Postgis DBA job vacancy

2012-12-26 Thread Gavin Flower
On 27/12/12 07:54, Berend Tober wrote: pcr...@pcreso.com wrote: Mat be of interest to someone here... http://careers.eroad.co.nz/vacancies/showVacancy/11 Brent Wood I attended a technical conference in the US recently, and someone posted an Auckland job flyer (not this same organization,

Re: [GENERAL] New Zealand Postgis DBA job vacancy

2012-12-26 Thread Gavin Flower
On 27/12/12 07:39, Adrian Klaver wrote: On 12/26/2012 10:30 AM, Gavin Flower wrote: Please do not top post! In New Zealand we generally use petrol, or diesel, measured in litres - though there are some cars powered by natural gas. I think the USA is one of the few places not using the metric

Re: [GENERAL] New Zealand Postgis DBA job vacancy

2012-12-26 Thread Gavin Flower
On 27/12/12 08:33, Adrian Klaver wrote: On 12/26/2012 11:20 AM, Gavin Flower wrote: On 27/12/12 07:39, Adrian Klaver wrote: On 12/26/2012 10:30 AM, Gavin Flower wrote: Please do not top post! In New Zealand we generally use petrol, or diesel, measured in litres - though there are some

Re: [GENERAL] Saving score of 3 players into a table

2011-10-25 Thread Gavin Flower
On 26/10/11 08:32, Alexander Farber wrote: Hello, I'm trying to save results of card game with 3 players into a table. It is bad enough, that I had to introduce 3 columns for user ids: id0, id1, id2 and 3 columns for their scores: money0, money1, money2 - create table pref_results (

Re: [GENERAL] Saving score of 3 players into a table

2011-10-25 Thread Gavin Flower
On 26/10/11 08:32, Alexander Farber wrote: Hello, I'm trying to save results of card game with 3 players into a table. It is bad enough, that I had to introduce 3 columns for user ids: id0, id1, id2 and 3 columns for their scores: money0, money1, money2 - create table pref_results (

Re: [GENERAL] All and ANY

2011-10-26 Thread Gavin Flower
On 27/10/11 02:38, salah jubeh wrote: Can someone please direct me where I can find documentation about ALL and ANY functions. I searched postgresql documentation but I did not find the appropriate pages Thanks in advance Read the reference URLs provided by the other replies, as I quote onl

Re: [GENERAL] nextval skips values between consecutive calls

2011-10-29 Thread Gavin Flower
On 29/10/11 05:59, Merlin Moncure wrote: On Fri, Oct 28, 2011 at 11:32 AM, wrote: -Original Message- From: Merlin Moncure [mailto:mmonc...@gmail.com] Sent: Friday, October 28, 2011 8:29 PM To: Dmitry Epstein Cc: t...@sss.pgh.pa.us; pgsql-general@postgresql.org; Peter Gagarinov Subject:

Re: [GENERAL] partitioning a dataset + employing hysteresis condition

2011-11-15 Thread Gavin Flower
On 14/11/11 18:35, Amit Dor-Shifer wrote: On Mon, Nov 14, 2011 at 4:29 PM, Amit Dor-Shifer mailto:amit.dor.shi...@gmail.com>> wrote: Hi, I've got this table: create table phone_calls ( start_time timestamp, device_id integer, term_status integer );

Re: [GENERAL] partitioning a dataset + employing hysteresis condition

2011-11-15 Thread Gavin Flower
On 14/11/11 18:35, Amit Dor-Shifer wrote: On Mon, Nov 14, 2011 at 4:29 PM, Amit Dor-Shifer mailto:amit.dor.shi...@gmail.com>> wrote: Hi, I've got this table: create table phone_calls ( start_time timestamp, device_id integer, term_status integer );

Re: [GENERAL] Is it ever necessary to vacuum a table that only gets inserts/updates?

2011-11-18 Thread Gavin Flower
On 18/11/11 04:59, Tom Lane wrote: Craig Ringer writes: On Nov 17, 2011 1:32 PM, "Tom Lane" wrote: If it's purely an insert-only table, such as a logging table, then in principle you only need periodic ANALYZEs and not any VACUUMs. Won't a VACUUM FREEZE (or autovac equivalent) be necessary e

Re: [GENERAL] Is it ever necessary to vacuum a table that only gets inserts/updates?

2011-11-19 Thread Gavin Flower
On 19/11/11 11:32, Adam Cornett wrote: On Fri, Nov 18, 2011 at 2:56 PM, Gavin Flower mailto:gavinflo...@archidevsys.co.nz>> wrote: On 18/11/11 04:59, Tom Lane wrote: Craig Ringermailto:ring...@ringerc.id.au>> writes: On Nov 17, 2011 1:32 PM, "

Re: [GENERAL] Table Design question for gurus (without going to "NoSQL")...

2011-11-20 Thread Gavin Flower
On 21/11/11 02:33, Phoenix Kiula wrote: Hi. Want to start another thread, loosely related to the performance problems thread I have going. Need some DB design guidance from the gurus here. My big table now has about 70 million rows, with the following columns: alias | character v

Re: [GENERAL] Is it ever necessary to vacuum a table that only gets inserts/updates?

2011-11-20 Thread Gavin Flower
On 20/11/11 11:57, Scott Marlowe wrote: On Sat, Nov 19, 2011 at 12:53 PM, Gavin Flower wrote: On 19/11/11 11:32, Adam Cornett wrote: On Fri, Nov 18, 2011 at 2:56 PM, Gavin Flower wrote: On 18/11/11 04:59, Tom Lane wrote: Craig Ringerwrites: On Nov 17, 2011 1:32 PM, "Tom

Re: [GENERAL] Table Design question for gurus (without going to "NoSQL")...

2011-11-20 Thread Gavin Flower
On 21/11/11 14:50, Phoenix Kiula wrote: On Mon, Nov 21, 2011 at 7:26 AM, Gavin Flower wrote: How about having 2 indexes: one on each of ip& url_md5? Pg will combine the indexes as required, or will just use one if that is best. Thanks Gavin. Question: what if I have a joined index

Re: [GENERAL] How to write a own parser for full text search

2011-11-21 Thread Gavin Flower
On 21/11/11 22:51, Antonio Franzoso wrote: Hi all, I have installed PostgreSQL server on a Windows Server 2008 server and I need to write a more complex parser than the default one in PostgreSQL. Searching on internet i found this example: http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/

Re: [GENERAL] PostgreSQL DBA in SPAAAAAAAACE

2011-12-23 Thread Gavin Flower
On 21/12/11 04:07, Joe Miller wrote: Thanks so much to everybody who voted. I really can't express my gratitude. I'd love to head to the pub and buy everybody a drink, but I think that might cost more than the flight. Joe On Tue, Dec 20, 2011 at 10:04 AM, Alban Hertroys wrote: On 20 Decembe

Re: [GENERAL] MS Access easier with PostgreSQL or MySQL?

2012-01-30 Thread Gavin Flower
On 30/01/12 11:27, gvim wrote: I want to use MS Access 2007 as a front end to a more robust/FOSS database. Which is more compatible - MySQL or PostgreSQL? Unbiased answers please :-). gvim Well I have done searches on the Net 3 times since I first came across PostgresSQL in 2001, and each t

Re: [GENERAL] Stability in Windows?

2012-02-25 Thread Gavin Flower
On 25/02/12 04:39, Durumdara wrote: Hi! We planned to port some very old DBASE db into PGSQL. But somebody said in a developer list that he tried with PGSQL (8.x) and it was very unstable in Windows (and it have problem when many users use it). Another people also said that they used PGSQL

Re: [GENERAL] what Linux to run

2012-03-03 Thread Gavin Flower
On 02/03/12 01:25, Ivan Voras wrote: On 28/02/2012 18:17, Rich Shepard wrote: On Tue, 28 Feb 2012, mgo...@isstrucksoftware.net wrote: If we move to Linux, what is the preferred Linux for running Postgres on. This machine would be dedicated to the database only. Michael, There is no 'prefe

Re: [GENERAL] what Linux to run

2012-03-03 Thread Gavin Flower
On 03/03/12 23:33, Leif Biberg Kristensen wrote: Lørdag 3. mars 2012 01.43.29 skrev Gavin Flower : I think if you are going to select a member of the Debian family, I would strongly recommend Debian itself. I have the impression that the Debian community is more serious about quality than

Re: [GENERAL] what Linux to run

2012-03-04 Thread Gavin Flower
On 04/03/12 09:49, John R Pierce wrote: On 03/03/12 2:55 AM, Gavin Flower wrote: My knowledge of Debian is via friend's (an extremely competent and experienced Unix guy who got me into Linux & who still runs Debian) comments and what I've noticed on the web. For a Deskt

Re: [GENERAL] what Linux to run

2012-03-06 Thread Gavin Flower
Hmm... I also use 64 bit Fedora 16, on an AMD quad core at home, and on a dual Xeon quad cores at work. For a desktop environment, I would recommend xfce for serious work over GNOME 3. However, GNOME 3 is fine if you prefer fashion over functionality. I have 25 virtual desktops, and make ful

Re: [GENERAL] Question on datatypes returned for "select oid, typname from pg_type"

2012-03-09 Thread Gavin Flower
On 10/03/12 09:15, Tom Lane wrote: Alexander Reichstadt writes: to find out what datatypes exist. When checking on a certain field, it returned 17 as a type, thus being a bytea. That's actually the question now, because, is it always that bytea gets oid 17 or are these assignments of type name

Re: [GENERAL] Searchable chess positions in a Postgress DB

2012-04-11 Thread Gavin Flower
On 11/04/12 19:15, Sidney Cadot wrote: Dear all, As a hobby project, I am toying around with a database containing about 5 million chess games. On average, these games have about 80 positions (~ 40 moves by both black and white), which means there are about 400 million chess positions in there.

Fwd: Re: [GENERAL] Searchable chess positions in a Postgress DB

2012-04-12 Thread Gavin Flower
Original Message Subject:Re: [GENERAL] Searchable chess positions in a Postgress DB Date: Fri, 13 Apr 2012 00:33:17 +1200 From: Gavin Flower Organisation: ArchiDevSys To: Sidney Cadot On 12/04/12 01:14, Sidney Cadot wrote: Hi Gavin, I appreciate the

Re: [GENERAL] Searchable chess positions in a Postgress DB

2012-04-12 Thread Gavin Flower
On 11/04/12 21:24, Gavin Flower wrote: On 11/04/12 19:15, Sidney Cadot wrote: Dear all, As a hobby project, I am toying around with a database containing about 5 million chess games. On average, these games have about 80 positions (~ 40 moves by both black and white), which means there are

<    1   2   3