[GENERAL] text_pattern_ops index not being used for prefix query

2016-10-20 Thread Alexander Staubo
Indexing on a text column: create index index_documents_on_id_with_pattern_ops (id text_pattern_ops); This works fine: > explain select id from documents where id like 'dingbat%'; Index Only Scan using index_documents_on_id_with_pattern_ops on documents (cost=0.56..8.58 rows=736 wi

Re: [GENERAL] text_pattern_ops index not being used for prefix query

2016-10-21 Thread Alexander Staubo
On 20 Oct 2016, at 23:37, Maxim Boguk wrote: > ​Underscore in like pattern have a special meaning of "any symbol". > From documentation on the > https://www.postgresql.org/docs/9.4/static/functions-matching.html : > "An underscore (_) in pattern stands for (matches) any single character;" > This

[GENERAL] Counting queries

2007-06-01 Thread Alexander Staubo
One year ago there was a brief discussion about possibly implementing stats for the number of queries (ie., selects) executed by the server: http://archives.postgresql.org/pgsql-performance/2006-05/msg00428.php I was hoping for something akin to the pg_stat_*_tables and its n_tup_{ins,del,upd}

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/1/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: I'm disappointed because SLONY-II has not been released yet to support multi-master replication! I wouldn't pin all my hopes on a project still under development. (For me, personally, add the fact that Slony-I still has not solved single-m

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/1/07, Joshua D. Drake <[EMAIL PROTECTED]> wrote: > In the meantime, Cybertec (http://www.postgresql.at/, an Austrian > company) just announced a commercial synchronous multimaster > replication product based on 2-phase commit. It's expensive, and I [snip] I could be completely cranked but

Re: multimaster (was: [GENERAL] Slightly OT.)

2007-06-01 Thread Alexander Staubo
On 6/1/07, Andrew Sullivan <[EMAIL PROTECTED]> wrote: These are all different solutions to different problems, so it's not surprising that they look different. This was the reason I asked, "What is the problem you are trying to solve?" You mean aside from the obvious one, scalability? The dat

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/1/07, Jeff Davis <[EMAIL PROTECTED]> wrote: On Fri, 2007-06-01 at 17:00 +0200, Alexander Staubo wrote: > the projected Slony-II design, but the setup seems dead simple, and > from the docs I have found it seems to transparently replicate schema > changes, unlike Slony-I. So t

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/1/07, Joshua D. Drake <[EMAIL PROTECTED]> wrote: As the owner of a company that actually actively developing a replication system and has for years... I suggest you start putting your code where your words are. That doesn't make any sense. As a database *user* it's my prerogative to critic

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/1/07, Andrew Sullivan <[EMAIL PROTECTED]> wrote: > I could be wrong, but I believe Slony fails at this because it is > trigger-based and simply cannot detect DDL changes. No, there were in fact alternatives (like, for instance, patching the back end code). But that was undesirable for the

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/2/07, Gregory Stark <[EMAIL PROTECTED]> wrote: "Alexander Staubo" <[EMAIL PROTECTED]> writes: > I would love for the answer to have been "sorry, we did not have time > or manpower enough to implement fully transparent replication yet, > because it'

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/1/07, Andrew Sullivan <[EMAIL PROTECTED]> wrote: On Fri, Jun 01, 2007 at 11:08:50PM +0200, Alexander Staubo wrote: > That doesn't make any sense. As a database *user* it's my prerogative > to criticize the bits that make my life painful. Sure. And as a user of fre

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/2/07, Andrew Sullivan <[EMAIL PROTECTED]> wrote: On Sat, Jun 02, 2007 at 12:05:20AM +0200, Alexander Staubo wrote: > All you would require is a simple boolean flag to enable or disable > automatic DDL propagation, surely. You know, it is just possible that some of the respo

Re: [GENERAL] Slightly OT.

2007-06-01 Thread Alexander Staubo
On 6/2/07, Jeff Davis <[EMAIL PROTECTED]> wrote: Here is some work going on that looks like what you want: http://archives.postgresql.org/pgsql-hackers/2007-03/msg00050.php I had no idea someone was working on WAL-log-based replication; I saw the TODO entry a while ago, but I missed the thread

Re: [GENERAL] High-availability

2007-06-01 Thread Alexander Staubo
On 6/1/07, Madison Kelly <[EMAIL PROTECTED]> wrote: After realizing that 'clustering' in the PgSQL docs means multiple DBs behind one server, and NOT multple machines, I am back at square one, feeling somewhat the fool. :P I remember being similarly disappointed in this rampant co-opting of

Re: [GENERAL] multimaster

2007-06-01 Thread Alexander Staubo
On 6/1/07, Joshua D. Drake <[EMAIL PROTECTED]> wrote: Alexander Staubo wrote: > You mean aside from the obvious one, scalability? Multimaster doesn't give you scalability (at least not like a lot of people think it does). That depends on your particular definition of multimaste

Re: [GENERAL] multimaster

2007-06-01 Thread Alexander Staubo
On 6/2/07, Guy Rouillier <[EMAIL PROTECTED]> wrote: Have you looked at raidb? http://c-jdbc.objectweb.org. Narrow niche, but if it happens to be the one you are in, then it's an option. I took a quick look at the user's page, and both of them were using PostgreSQL. Looked at it briefly. C-JD

Re: [GENERAL] multimaster

2007-06-01 Thread Alexander Staubo
On 6/1/07, Chris Browne <[EMAIL PROTECTED]> wrote: There would be *some* scalability gains to be had, but the primary reason for looking for multimaster replication is that you need high availability so badly that you are willing to give up performance to get it. ...dependent on some specific d

Re: [GENERAL] multimaster

2007-06-02 Thread Alexander Staubo
On 6/2/07, Martijn van Oosterhout <[EMAIL PROTECTED]> wrote: I don't know if it's a general problem, but I've been involved in a using rails and it appears to have it's own way of declaring the database. It presumes to handle referential integrity and uniqueness in the application code (!). I t

Re: [GENERAL] Transactional DDL

2007-06-02 Thread Alexander Staubo
On 6/2/07, Jasbinder Singh Bali <[EMAIL PROTECTED]> wrote: [snip] I believe that if a database supports transactional ddl then ddl1 and ddl2 would commit together as a batch And If a Db doesn't support this transactional DDL feature then ddl1 executes and commits without even caring about ddl2. R

Re: [GENERAL] High-availability

2007-06-02 Thread Alexander Staubo
On 6/3/07, Madison Kelly <[EMAIL PROTECTED]> wrote: > Slony is indeed intended for near-real-time replication; it's > asynchronous, so slaves always lag behind the master. The amount of > discrepancy depends on a bunch of factors -- individual node > performance, network performance, and system l

Re: [GENERAL] High-availability

2007-06-02 Thread Alexander Staubo
On 6/3/07, Alexander Staubo <[EMAIL PROTECTED]> wrote: As a side-note, I sat up pgpool-II today, and was pleasantly surprised about how easy it all was; within two minutes I had two databases in perfect sync on my laptop. It has limitations (such as in its handling of sequences), but compa

Re: [GENERAL] multimaster

2007-06-03 Thread Alexander Staubo
On 6/3/07, Ian Harding <[EMAIL PROTECTED]> wrote: Rails propaganda explicitly proposes not "repeating yourself" and [...] The creator of RoR explicitly discourages use of RI, rules, triggers, etc in the database as unnecessary. His disciples take this as gospel. The creator of Rails is not t

Re: NULLS and User Input WAS Re: [GENERAL] multimaster

2007-06-03 Thread Alexander Staubo
On 6/3/07, Ian Harding <[EMAIL PROTECTED]> wrote: > An empty string is not null! Null means the value is missing, which is > clearly not the case here. I would say Rails is exactly in the right > here. When an HTML form is posted, empty input boxes are declared as > empty strings, which what the

Re: NULLS and User Input WAS Re: [GENERAL] multimaster

2007-06-03 Thread Alexander Staubo
On 6/3/07, Ian Harding <[EMAIL PROTECTED]> wrote: On 6/3/07, Alexander Staubo <[EMAIL PROTECTED]> wrote: > Your patch is awful because it would mean there was no way to enter an > empty string in the database. A one-character string containing a > single space is not an em

Re: [GENERAL] multimaster

2007-06-03 Thread Alexander Staubo
On 6/3/07, Martijn van Oosterhout <[EMAIL PROTECTED]> wrote: > For example, part of the point of having validations declared on the > model is so that you can raise user-friendly errors (and pipe them > through gettext for localization) such as "Your password must be at > least 4 characters long

Re: [GENERAL] multimaster

2007-06-03 Thread Alexander Staubo
On 6/4/07, Jeff Davis <[EMAIL PROTECTED]> wrote: On Sun, 2007-06-03 at 22:54 +0200, Alexander Staubo wrote: > I agree with you and I don't; as it stands now, it's too hard to > implement validation in the database alone, for the reasons I stated > earlier. But I would l

Re: [GENERAL] multimaster

2007-06-04 Thread Alexander Staubo
On 6/4/07, Tino Wildenhain <[EMAIL PROTECTED]> wrote: Did you have a look at BizgresMPP? Especially for your shared-nothing approach it seems to be a better solution then just replicating everything. I had completely forgotten about that one. Bizgres.org seems down at the moment, but looking a

Re: NULLS and User Input WAS Re: [GENERAL] multimaster

2007-06-04 Thread Alexander Staubo
On 6/4/07, Andrew Sullivan <[EMAIL PROTECTED]> wrote: On Mon, Jun 04, 2007 at 12:37:42AM +0200, PFC wrote: > NULL usually means "unknown" or "not applicable" Aaaargh! No, it doesn't. It means NULL. Nothing else. If it meant unknown or not applicable or anything else, then SELECT * F

Re: [GENERAL] Looking for Graphical people for PostgreSQL tradeshow signage

2007-06-07 Thread Alexander Staubo
On 6/7/07, Joshua D. Drake <[EMAIL PROTECTED]> wrote: Joshua D. Drake wrote: > Hello, Is anyone going to try for this? If not I can have our designer do it, but I would prefer it be a community deal. > > We are looking to have new signage for the shows that PostgreSQL > attends. The signage tha

Re: [GENERAL] cube problem

2007-06-08 Thread Alexander Staubo
On 6/8/07, ABHANG RANE <[EMAIL PROTECTED]> wrote: Hi, I have a table with one column as real[]. Now if I want to make cubes out of each of these arrays, is there a way in postgre I can do it. I guess cube operator is not defined for real[] but can I create cubes if the column was integer[]. If ye

Re: [GENERAL] Using the GPU

2007-06-08 Thread Alexander Staubo
On 6/8/07, Billings, John <[EMAIL PROTECTED]> wrote: Does anyone think that PostgreSQL could benefit from using the video card as a parallel computing device? I'm working on a project using Nvidia's CUDA with an 8800 series video card to handle non-graphical algorithms. I'm curious if anyone

Re: [GENERAL] insane index scan times

2007-06-08 Thread Alexander Staubo
On 6/8/07, Martijn van Oosterhout <[EMAIL PROTECTED]> wrote: On Thu, Jun 07, 2007 at 11:20:20AM -0700, Sergei Shelukhin wrote: > Version is 8.1 > The query I originally ran returned ~4-5 rows and had a lot of other > joins and filtering conditions prior to the join with the big table. > Is there

Re: [GENERAL] When should I worry?

2007-06-10 Thread Alexander Staubo
On 6/10/07, Tom Allison <[EMAIL PROTECTED]> wrote: The table itself is small (two columns: bigint, int) but I'm wondering when I'll start to hit a knee in performance and how I can monitor that. You don't say anything about what the data is in the table or what queries you run against it, so th

Re: [GENERAL] Distributing PostGres database to various customers

2007-06-11 Thread Alexander Staubo
On 6/11/07, Mike Gould <[EMAIL PROTECTED]> wrote: How can we do this with PostGres? Other than backup and restore or creating SQL scripts I haven't been able to find another method. Some of these tables may have over a million rows in them initially if we convert old data. The most portable w

Re: [GENERAL] Using the GPU

2007-06-16 Thread Alexander Staubo
On 6/16/07, Tom Allison <[EMAIL PROTECTED]> wrote: It might make an interesting project, but I would be really depressed if I had to go buy an NVidia card instead of investing in more RAM to optimize my performance! Why does it matter what kind of hardware you can (not "have to") buy to give

Re: [GENERAL] What O/S or hardware feature would be useful for databases?

2007-06-16 Thread Alexander Staubo
On 6/16/07, Ron Johnson <[EMAIL PROTECTED]> wrote: > Hardware acceleration for quickly counting the number of > set/unset/matching bits? x86 doesn't already do that? I don't think so. The fastest way, I believe, is to use precomputed lookup tables. Same for finding the least/most significant s

Re: [GENERAL] Using the GPU

2007-06-16 Thread Alexander Staubo
On 6/16/07, Tom Lane <[EMAIL PROTECTED]> wrote: "Alexander Staubo" <[EMAIL PROTECTED]> writes: > On 6/16/07, Tom Allison <[EMAIL PROTECTED]> wrote: >> It might make an interesting project, but I would be really depressed >> if I had to go buy an NVid

Re: [GENERAL] What O/S or hardware feature would be useful for databases?

2007-06-16 Thread Alexander Staubo
On 6/17/07, Ron Johnson <[EMAIL PROTECTED]> wrote: On 06/16/07 17:05, Alexander Staubo wrote: > On 6/16/07, Ron Johnson <[EMAIL PROTECTED]> wrote: >> > Hardware acceleration for quickly counting the number of >> > set/unset/matching bits? >> >> x86

Re: [GENERAL] unexpected shutdown

2007-06-18 Thread Alexander Staubo
On 6/18/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: My database has shutdown several times in the last couple days. I have no idea why. [...] LOG: server process (PID 501) was terminated by signal 9 If this is Linux, check the kernel log (typically /var/log/kern.log, or run dmesg) and

Re: [GENERAL] Experiences of PostgreSQL on-disk bitmap index patch

2007-06-20 Thread Alexander Staubo
On 6/20/07, Christan Josefsson <[EMAIL PROTECTED]> wrote: Anyone using these patchese on production systems? If these are the same patches that were made for Bizgres, then they are bound to be in use in some current production systems of that version of PostgreSQL. If there's any PgSQL develo

Re: [GENERAL] Experiences of PostgreSQL on-disk bitmap index patch

2007-06-20 Thread Alexander Staubo
On 6/20/07, Joshua D. Drake <[EMAIL PROTECTED]> wrote: Just so there is no confusion. These WILL NOT be in 8.3: http://developer.postgresql.org/index.php/Todo:PatchStatus Apologies. I didn't know they had been put on hold. Alexander. ---(end of broadcast)-

Re: [GENERAL] Polymorphic delete help needed

2007-07-06 Thread Alexander Staubo
On 7/6/07, David Fetter <[EMAIL PROTECTED]> wrote: At some point, you're going to realize that Rails is the problem, not the solution. It's written by people who do not understand what a shared data store is and reflects problems inherent in its native database platform: MySQL 3.23. This is ra

Re: [GENERAL] Performance Question - Table Row Size

2007-07-09 Thread Alexander Staubo
On 7/9/07, Mike <[EMAIL PROTECTED]> wrote: I am designing my database and I was wondering whether my table row size effects the performance of querying my table. Please note that my table is being designed to hold high volume of records and I do not plan to do (select *) for retrieving them. That

Re: [GENERAL] TOAST, large objects and ACIDity

2007-07-10 Thread Alexander Staubo
On 7/10/07, Benoit Mathieu <[EMAIL PROTECTED]> wrote: I saw postgres offers at least 2 method : bytea column with TOAST, or large objects API. From the documentation: All large objects are placed in a single system table called pg_largeobject. PostgreSQL also supports a storage system calle

Re: [GENERAL] Mac OS X

2007-07-12 Thread Alexander Staubo
On 7/12/07, Tom Allison <[EMAIL PROTECTED]> wrote: I tried to install postgres onto my macbook via 'fink' and don't like it all that much. I decided to install from source, it's a fallback to my slackware days. Try MacPorts (http://www.macports.org/), a modern BSD-style ports system for OS X. T

Re: [GENERAL] Updates/Changes to a database

2007-07-13 Thread Alexander Staubo
On 7/12/07, imageguy <[EMAIL PROTECTED]> wrote: Are there pre-existing tools out there that does this sort of thing ?? Rails and Django -- two popular web development frameworks -- support a simple mechanism for doing schema migrations. In Rails, in particular, each schema change is encapsulat

Re: [GENERAL] Possible new feature

2007-07-30 Thread Alexander Staubo
On 7/30/07, mgould <[EMAIL PROTECTED]> wrote: > I'm in the process of moving to PostGres from iAnywhere's SQL Anywhere v 10. > One of the neat features from ASA 10 is the ability to create "proxy > tables" These tables can be local or remote. Check out the dblink contrib module that comes with P

Re: [GENERAL] pgpool2 vs sequoia

2007-08-06 Thread Alexander Staubo
On 8/6/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > the last few years we ran with horizontal partitioning. i always ran into > problems with horizontal partioning because few tables must be shared across > the databases and sometimes things are moving and i got lot of trouble with > my prima

Re: [GENERAL] clustering failover... ala Oracle Parallel server

2007-08-07 Thread Alexander Staubo
On 8/4/07, hanasaki <[EMAIL PROTECTED]> wrote: > clustering failover... ala Oracle Parallel server Note that OPS is now called RAC (see http://orafaq.com/faq/what_is_rac_ops). > How can the server be setup in a cluster for load-balancing and failover > like perhaps OPS? As I understand it, RAC i

Re: [GENERAL] Transactional DDL

2007-08-15 Thread Alexander Staubo
On 8/15/07, Harpreet Dhaliwal <[EMAIL PROTECTED]> wrote: > And this feature i.e. transactional DDL is not there in other major RDBMS > like sql server, oracle etc? The subject of transactional DDL and its prevalence was discussed in a May thread, "why postgresql over other RDBMS" (http://archives.

Re: [GENERAL] PostgreSQL vs Firebird feature comparison finished

2007-08-24 Thread Alexander Staubo
On 8/24/07, Dave Page <[EMAIL PROTECTED]> wrote: > Alban Hertroys wrote: > > So actually the remark shouldn't be that "the multi-threaded > > architecture is only advantageous on Windows", but more like "the > > multi-process architecture is disadvantageous on Windows and hence a > > multi-threade

Re: [GENERAL] query help

2007-09-13 Thread Alexander Staubo
On 9/13/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > hello > > table is > +---+---+--+---+ > | id | one | two | three | > +---+---+--+---+ > | first | Jack | Jill | Mary | > | last | Ja | Ji | Ma | > +---+---+--+---+ > > result is > +

Re: [GENERAL] query help

2007-09-13 Thread Alexander Staubo
On 9/13/07, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > i add more column not row for new user. i want all "last like 'J%'". > http://www.nabble.com/an-other-provokative-question---tf4394285.html Sorry, but the only difference between your table example and your result example was the absence,

Re: [GENERAL] read-only queries on PITRslaves, any progress?

2007-09-18 Thread Alexander Staubo
On 9/15/07, Marinos Yannikos <[EMAIL PROTECTED]> wrote: > this might not be the best place to ask, but has there been any further > progress or an alternative project to Florian Pflug's SoC 2007 proposal > about enabling PITR slaves to serve read-only queries? It seems like an > elegant way to load

Re: [GENERAL] read-only queries on PITRslaves, any progress?

2007-09-18 Thread Alexander Staubo
On 9/18/07, Merlin Moncure <[EMAIL PROTECTED]> wrote: > Florian has been hard at work on getting the lazy xid assignment patch > in for 8.3, which is now complete. AIUI, this is an important step > towards read only pitr slave (with other advantages too), and shows > that things are moving along.

Re: [GENERAL] Version 8.3

2007-10-27 Thread Alexander Staubo
On 10/27/07, Bob Pawley <[EMAIL PROTECTED]> wrote: > I would like to try PostgreSQL 8.3 without uninstalling version 8.1. > > Is this possible?? Sure. If you're on Unix, download the source and install it somewhere in, say, your home directory. This requires a certain familiarity with the shell, h

Re: [GENERAL] FW: Chunk Delete

2007-11-15 Thread Alexander Staubo
[Reposting accidental private response to list] On 11/15/07, Abraham, Danny <[EMAIL PROTECTED]> wrote: > How do I add a note to a thread? You add pgsql-general@postgresql.org to To: or Cc:. Your mail program probably has a "Reply to all" button that will accomplish this. > THE problem is that th

Re: [GENERAL] Chunk Delete

2007-11-15 Thread Alexander Staubo
On 11/15/07, Abraham, Danny <[EMAIL PROTECTED]> wrote: > With Oracle we do it with: delete ,tname> where and rownum < Y; You could create a temporary sequence: create temporary sequence foo_seq; delete from foos where nextval('foo_seq') < 5; I'm not sure how fast nextval() is, even o

Re: [GENERAL] Chunk Delete

2007-11-15 Thread Alexander Staubo
On 11/15/07, Abraham, Danny <[EMAIL PROTECTED]> wrote: > In Oracle we erase 50,000 records using the following: > > Delete where and ROWNUM < 5; > > Do we have such a feature in PG? Just delete with a subselect: delete from where in ( select from order by limit 5); For examp

Re: [GENERAL] replication in Postgres

2007-11-25 Thread Alexander Staubo
On 11/25/07, Glyn Astill <[EMAIL PROTECTED]> wrote: > So far the only methods I see would be usable for us are Slony I and > WAL log shipping. WAL shipping probably does not work the way you think it does. The secondary server that receives the log pieces is not actually able to serve any queries;

Re: [GENERAL] PostgresSQL vs Ingress

2007-11-30 Thread Alexander Staubo
On 11/30/07, Peter Childs <[EMAIL PROTECTED]> wrote: > Now We used somthing called Ingres at University (I graduated in 2000) but > I've not heard anything about it since and google does not return anything. > So we might be talking about different products? http://en.wikipedia.org/wiki/Ingres A

Re: [GENERAL] Replication using WAL files

2007-12-07 Thread Alexander Staubo
On 12/7/07, Josh Harrison <[EMAIL PROTECTED]> wrote: > I have 2 servers on which I need to have data replicated. The master server > should serve for read/write queries and the 2nd server is used mainly for > research queries(read-only queries) and so it doesn't have to be up-to-date. ... > Is it p

[GENERAL] Selecting max(pk) is slow on empty set

2008-01-22 Thread Alexander Staubo
This is on a fresh pg_restore copy that I have additionally vacuumed and analyzed. These queries, on a table containing 2.8 million rows, are very fast: # select count(*) from user_messages where user_id = 13604; count --- 0 (1 row) Time: 0.604 ms # select * from user_messages where use

Re: [GENERAL] Selecting max(pk) is slow on empty set

2008-01-22 Thread Alexander Staubo
On 1/22/08, Richard Huxton <[EMAIL PROTECTED]> wrote: > Alexander Staubo wrote: > > # explain analyze select max(id) from user_messages where user_id = 13604; > > &g

Re: [GENERAL] Selecting max(pk) is slow on empty set

2008-01-22 Thread Alexander Staubo
On 1/22/08, Richard Huxton <[EMAIL PROTECTED]> wrote: > Hmm, but with an estimated cost of 3646 (vs.633 for the max(*) which > uses the wrong index). That explains why it's walking backwards through > the pkey index, it thinks that it's 8 times cheaper. [...] > Have a look at most_common_vals,most_

Re: [GENERAL] Selecting max(pk) is slow on empty set

2008-01-22 Thread Alexander Staubo
On 1/22/08, Richard Huxton <[EMAIL PROTECTED]> wrote: > Although the row-estimate still seems quite high. You might want to > increase it even further (maximum is 1000). If this is a common query, > I'd look at an index on (user,id) rather than just (user) perhaps. Actually that index (with the sa

Re: [GENERAL] Selecting max(pk) is slow on empty set

2008-01-22 Thread Alexander Staubo
On 1/22/08, Richard Huxton <[EMAIL PROTECTED]> wrote: > Alexander Staubo wrote: > > On 1/22/08, Richard Huxton <[EMAIL PROTECTED]> wrote: > >> Although the row-estimate still seems quite high. You might want to > >> increase it even further (maximum is 100

Re: [GENERAL] DB design: How to store object properties?

2008-02-17 Thread Alexander Staubo
On 2/17/08, Maxim Khitrov <[EMAIL PROTECTED]> wrote: > So the scenario is this. We have two projects starting that will deal > heavily with mapping spatial regions. One of the reasons I'm looking > at PostgreSQL is the PostGIS extension that may help us in dealing > with all the geometry. >From yo

Re: [GENERAL] Optimzing Postgresql

2008-05-24 Thread Alexander Staubo
On 5/24/08, Ram Ravichandran <[EMAIL PROTECTED]> wrote: > I am deciding between MySQL and Postgres. I'm leaning towards Postgres > mainly due the widely publicized speed when using transactions. However, I > am not able to find any good books / resources for tuning/ optimizing the > database. Is th

[GENERAL] Weird disk write load caused by PostgreSQL?

2006-10-02 Thread Alexander Staubo
I have a production PostgreSQL instance (8.1 on Linux 2.6.15) that seems to be writing data to disk at rates that I think are disproportional to the update load imposed on the database. I am looking for ways to determine the cause of this I/O. As an example, here is a typical graph produced

Re: [GENERAL] Weird disk write load caused by PostgreSQL?

2006-10-02 Thread Alexander Staubo
On Oct 2, 2006, at 17:50 , Tom Lane wrote: Alexander Staubo <[EMAIL PROTECTED]> writes: I have a production PostgreSQL instance (8.1 on Linux 2.6.15) that seems to be writing data to disk at rates that I think are disproportional to the update load imposed on the database. I am looki

Re: [GENERAL] Weird disk write load caused by PostgreSQL?

2006-10-02 Thread Alexander Staubo
running queries concurrently, but I suppose I will have to look more closely at our query patterns. Alexander. On Oct 2, 2006, at 19:25 , Alexander Staubo wrote: On Oct 2, 2006, at 17:50 , Tom Lane wrote: Alexander Staubo <[EMAIL PROTECTED]> writes: I have a production PostgreSQL i

Re: [GENERAL] Determining size of a database before dumping

2006-10-02 Thread Alexander Staubo
On Oct 2, 2006, at 22:17 , Madison Kelly wrote: I am (re)writing a backup program and I want to add a section for backing up pSQL DBs. In the planning steps (making sure a given destination has enough space) I try to calculate how much space will be needed by a 'pg_dump' run *before* actu

Re: [GENERAL] Determining size of a database before dumping

2006-10-02 Thread Alexander Staubo
On Oct 2, 2006, at 23:19 , Tom Lane wrote: Alexander Staubo <[EMAIL PROTECTED]> writes: You could count the disk space usage of the actual stored tuples, though this will necessarily be inexact: http://www.postgresql.org/docs/8.1/static/diskusage.html Or you could count the size

Re: [GENERAL] Major Performance decrease after some hours

2006-10-05 Thread Alexander Staubo
It appears to me that work_mem is a more significant configuration option than previously assumed by many PostgreSQL users, myself included. As with many database optimizations, it's an obscure problem to diagnose because you generally only observe it through I/O activity. One possibility

Re: [GENERAL] Major Performance decrease after some hours

2006-10-05 Thread Alexander Staubo
e about 400-500tps which seems to be quite reasonable. I also tried to disable drbd and put the data directory elsewhere, but the performance was the same. any ideas? thx, Peter 2006/10/5, Alexander Staubo <[EMAIL PROTECTED]>: > It appears to me that work_mem is a more significant c

Re: [GENERAL] Storing images in PostgreSQL databases (again)

2006-10-05 Thread Alexander Staubo
On Oct 5, 2006, at 16:18 , Merlin Moncure wrote: I see little value to storing the images in the database. For me that's a general statement (I'm sure others will disagree); but especially in your case, where you have a high volume and only want to store them for a couple days. Why incur

Re: [GENERAL] Storing images in PostgreSQL databases (again)

2006-10-05 Thread Alexander Staubo
On Oct 5, 2006, at 19:47 , DEV wrote: I have seen several posts pertaining to the "overhead" difference in storing in a db table versus the file system. What is this difference? Well, there's not much space overhead to speak of. I tested with a bunch of JPEG files: $ find files | wc -l

Re: [GENERAL] Storing images in PostgreSQL databases (again)

2006-10-05 Thread Alexander Staubo
On Oct 6, 2006, at 01:29 , Jean-Christophe Roux wrote: By the way, is it practical to set a bytea column (containing pictures) as primary key? That would severely slow down many operations I guess. Why would you? It's possible, but completely impractical, since image data typically exceed

Re: [GENERAL] performace review

2006-10-07 Thread Alexander Staubo
On Oct 7, 2006, at 20:06 , Tomi NA wrote: I was just reading http://www.opencrx.org/faq.htm where RDBMS engines are one of the questions and see pgsql bashed sentence after sentence. Can anyone offer any insight as to weather it's fact or FUD? As with any use of a database, it is useless and/o

Re: [GENERAL] performace review

2006-10-07 Thread Alexander Staubo
On Oct 7, 2006, at 23:44 , Brandon Aiken wrote: I download the db source (inside opencrx-1.9.1- core.postgresql-8.zip) and executed their three schema files, dbcreate-indexes.sql, dbcreate-views.sql, dbcreate-tables.sql. Each of the 118 tables has a three-field composite primary key of 'P

Re: [GENERAL] adjusting primary key

2006-10-10 Thread Alexander Staubo
On Oct 10, 2006, at 15:59 , Rafal Pietrak wrote: Hi All, I have two tables: CREATE TABLE t1 (id int not null unique, info text); CREATE TABLE t2 (id int, grp int references t1(id), info text); Now, at certain point (both tables populated with tousends of records, and continuesly referenced by

Re: [GENERAL] postgresql.conf shared buffers

2006-10-11 Thread Alexander Staubo
On Oct 11, 2006, at 03:34 , Jim C. Nasby wrote: And increase estimated_cache_size to something close to how much memory you have. That would be "effective_cache_size". Alexander. ---(end of broadcast)--- TIP 6: explain analyze is your friend

Re: [GENERAL] Storing images in PostgreSQL databases (again)

2006-10-12 Thread Alexander Staubo
On Oct 13, 2006, at 01:36 , Robert L Mathews wrote: Michelle Konzack <[EMAIL PROTECTED]> wrote: I do this already but have problems since I have stored arround 130 million files on a server... > ... > MD5 hashes are 32 Bytes long, maybe they change it to 64 Bytes? I have already over 2000 co

Re: [GENERAL] more anti-postgresql FUD

2006-10-13 Thread Alexander Staubo
On Oct 11, 2006, at 16:54 , [EMAIL PROTECTED] wrote: I'm author and maintainer of ZABBIX and the manual. I would like to add some comments to the thread. [snip] I just did the test on PostgreSQL 7.4.12 and MySQL 5.0.22 (MyISAM, sorry had no configured InnoDB). Ubuntu 6.0.6, AMD64, 2GB, defau

Re: [GENERAL] more anti-postgresql FUD

2006-10-13 Thread Alexander Staubo
On Oct 13, 2006, at 17:13 , Andrew - Supernews wrote: On 2006-10-13, Alexander Staubo <[EMAIL PROTECTED]> wrote: On my box (Dell PowerEdge 1850, dual Xeon 2.8GHz, 4GB RAM, 10kRPM SCSI, Linux 2.6.15, Ubuntu) I get 1,100 updates/sec, compared to 10,000 updates/sec with MySQL/InnoDB, u

Re: [GENERAL] more anti-postgresql FUD

2006-10-13 Thread Alexander Staubo
On Oct 13, 2006, at 17:35 , Andrew - Supernews wrote: On 2006-10-13, Alexander Staubo <[EMAIL PROTECTED]> wrote: On Oct 13, 2006, at 17:13 , Andrew - Supernews wrote: Your disk probably has write caching enabled. A 10krpm disk should be limiting you to under 170 transactions/sec

Re: [GENERAL] not so sequential sequences

2006-10-17 Thread Alexander Staubo
On Oct 17, 2006, at 23:18 , Rhys Stewart wrote: Hi all, looking for a method to number a table sequentially, but the sequence only increments if the value in a certain column is different. as in [snip] Normalization could solve your problem and also improve your schema: -- The parish table cr

Re: [GENERAL] skip duplicate key error during inserts

2006-10-27 Thread Alexander Staubo
On Oct 27, 2006, at 14:56 , Ron Johnson wrote: I think you completely missed that I am recommending using '\set ON_ERROR_ROLLBACK on' in psql. Please refer to my previous post and see the effect of the following line: postgres=# \set ON_ERROR_ROLLBACK on But I do *not* want my whole trans

Re: [GENERAL] Scalability

2006-10-28 Thread Alexander Staubo
On Oct 29, 2006, at 02:31 , Bill wrote: I was surprised to learn that PostgreSQL creates a new process for each connection. Doesn't this severely limit its scalability by consuming resources rapidly on the server as the number of user increases? On Windows, yes; Win32 processes carry a not i

Re: [GENERAL] postgresql books and convertion utilities

2006-10-30 Thread Alexander Staubo
On Oct 30, 2006, at 03:30 , Ganbold wrote: Which one is worth from following books? 1. PostgreSQL (2nd Edition) by Korry Douglas (Paperback - Jul 26, 2005) This is a good book. As far as I know it's the most up-to-date general-purpose PostgreSQL book. If you are interested in previewing

Re: [GENERAL] dividing integers not producing decimal fractions

2006-11-03 Thread Alexander Staubo
On Nov 2, 2006, at 23:54 , [EMAIL PROTECTED] wrote: I'm trying to produce a decimal fraction by dividing integer fields like this fragment of the query: ...((cntoh0.count + cntoh1.count)/ttl_deptcat.ttlcount) as "Ratio"... ... How do I get fractions when dividing integers? Cast as something?

[GENERAL] Per-row security

2006-11-03 Thread Alexander Staubo
I am designing an application which requires fine-grained role-based security, where every logical object in the system has an ACL which expresses the permissions allowed by roles. Implementing this on a high level is trivial, but it must scale, and scale extremely well. I have some fairly

Re: [GENERAL] varchar

2006-11-05 Thread Alexander Staubo
On Nov 5, 2006, at 15:32 , Alain Roger wrote: I would like to allow web site user to fill a field and for that i would need a large varchar()...maybe something around 100.000 characters. i guess that VARCHAR can not hold so many character and that i should turn to bytea. Am I right or is t

Re: [GENERAL] [pgsql-general] Daily digest v1.6578 (20 messages)

2006-11-06 Thread Alexander Staubo
On Nov 6, 2006, at 21:00 , Marc Munro wrote: A fairly cursory look at your proposed model suggests that it will work, but is likely to have serious performance problems. The issue is not so much the simple queries on single views, but the complex queries your developers will almost certainl

Re: [GENERAL] [pgsql-general] Daily digest v1.6578 (20 messages)

2006-11-06 Thread Alexander Staubo
On Nov 6, 2006, at 21:00 , Marc Munro wrote: For an alternative approach, you might want to check out Veil: http://pgfoundry.org/projects/veil Addendum: I took Veil to be undocumented since the source archive only comes with Doxygen scripts; I thought the small "here" link on the Veil home

Re: [GENERAL] Table and Field namestyle best practices?

2006-11-08 Thread Alexander Staubo
On Nov 8, 2006, at 18:49 , novnov wrote: I've been using namestyles with mixed case like OrgID. That is much more readable than orgid. Probably a good convention to adopt would be to use namestyles like org_id. That change I can live with. Both are perfectly acceptable, though the mixed-ca

[GENERAL] Using GIN indexes on 8.2

2006-11-10 Thread Alexander Staubo
Two questions about GIN on 8.2. There's not much documentation about GIN, but this should be possible: create table foo (values text[]); create index foo_values_index on foo using gin (text); However, this then fails saying the operator "@" does not exist: select * from foo where values

Re: [GENERAL] Using GIN indexes on 8.2

2006-11-10 Thread Alexander Staubo
On Nov 10, 2006, at 16:16 , Teodor Sigaev wrote: Alexander Staubo wrote: Two questions about GIN on 8.2. There's not much documentation about GIN, but this should be possible: create table foo (values text[]); create index foo_values_index on foo using gin (text); However, this

Re: [GENERAL] ORDER BY

2006-11-15 Thread Alexander Staubo
On Nov 14, 2006, at 23:03 , MicroUser wrote: I need sorted result but the way like this: 0 | Anna 3 | Fernando 2 | Link 1 | Other Record '1 | Other' must by at the end of query result. It's not apparent from your example that you want something other than a purely lexicographic sort order

  1   2   >