Re: [GENERAL] Comparison of Oracle and PostgreSQL full text search

2010-07-29 Thread Howard Rogers
On Thu, Jul 29, 2010 at 10:33 PM, Dean Rasheed wrote: > On 28 July 2010 02:58, Howard Rogers wrote: >> For what it's worth, I wrote up the performance comparison here: >> http://diznix.com/dizwell/archives/153 >> > > Thanks, very interesting results. I wonder, a

Re: [GENERAL] Comparison of Oracle and PostgreSQL full text search

2010-07-28 Thread Howard Rogers
On Wed, Jul 28, 2010 at 8:38 PM, Daniel Verite wrote: >        zhong ming wu wrote: > >> I always thought there is a clause in their user agreement preventing >> the users from publishing benchmarks like that. I must be mistaken. > > No you're correct. Currently, to download the current Oracle 11.

[GENERAL] Comparison of Oracle and PostgreSQL full text search

2010-07-27 Thread Howard Rogers
Thanks to some very helpful input here in earlier threads, I was finally able to pull together a working prototype Full Text Search 'engine' on PostgreSQL and compare it directly to the way the production Oracle Text works. The good news is that PostgreSQL is bloody fast! The slightly iffy news is

Re: [GENERAL] Bitmask trickiness

2010-07-23 Thread Howard Rogers
On Fri, Jul 23, 2010 at 6:17 PM, Alban Hertroys wrote: >> I thought to do >> >> select * from coloursample where colour & 10 = 10; >> >> ...but that's not right, because it finds the third record is a match. > > > What's not entirely clear to me is whether you only want to find colours that > hav

Re: [GENERAL] Bitmask trickiness

2010-07-23 Thread Howard Rogers
> Hate to interrupt your flame war, and I apologize for not being precise in > my meaning first try... You don't need any bitwise anything to compare two > bitmasks-hiding-in-integers, just check for equality. > > Instead of "select * from coloursample where colour & 10 = 10;" just try > "select *

Re: [GENERAL] Bitmask trickiness

2010-07-23 Thread Howard Rogers
On Fri, Jul 23, 2010 at 7:57 PM, Stephen Cook wrote: > On 7/23/2010 5:33 AM, Howard Rogers wrote: >> >> ...so select * from table where 21205 | 4097 = 21205 would correctly >> grab that record. So I'm assuming you mean the 'stored value' should >> be on

Re: [GENERAL] Bitmask trickiness

2010-07-23 Thread Howard Rogers
On Fri, Jul 23, 2010 at 3:02 PM, Scott Marlowe wrote: >> If you mean, did I read the bit in the doco where it said nothing at >> all in the 'these are great advantages' style I've just described, but >> instead makes the fairly obvious point that a bit string takes 8 bits >> to store a group of 8

Re: [GENERAL] Bitmask trickiness

2010-07-22 Thread Howard Rogers
On Fri, Jul 23, 2010 at 8:37 AM, Scott Marlowe wrote: > On Thu, Jul 22, 2010 at 3:09 PM, Howard Rogers wrote: >> On Fri, Jul 23, 2010 at 12:35 AM, Peter Hunsberger >> wrote: >>> On Wed, Jul 21, 2010 at 11:13 PM, Howard Rogers wrote: >>>> >>>>

Re: [GENERAL] Bitmask trickiness

2010-07-22 Thread Howard Rogers
On Fri, Jul 23, 2010 at 12:35 AM, Peter Hunsberger wrote: > On Wed, Jul 21, 2010 at 11:13 PM, Howard Rogers wrote: >> >> On Thu, Jul 22, 2010 at 1:02 PM, Scott Marlowe >> wrote: >> >> >> >> >> >> Why on Earth would I want to store this

Re: [GENERAL] Bitmask trickiness

2010-07-21 Thread Howard Rogers
On Thu, Jul 22, 2010 at 1:02 PM, Scott Marlowe wrote: >> >> Why on Earth would I want to store this sort of stuff in a bit string?! > > Because you are manipulating bits and not integers?  I guess there are > 10 kinds of people, those who like think in binary and those who > don't. > >> I don't

Re: [GENERAL] Bitmask trickiness

2010-07-21 Thread Howard Rogers
On Wed, Jul 21, 2010 at 9:17 PM, Mathieu De Zutter wrote: > On Wed, Jul 21, 2010 at 5:59 AM, Howard Rogers wrote: >> It's also easy to find records which have either some yellow or some >> orange (or both) in them: >> >> select * from coloursample where colour

[GENERAL] Bitmask trickiness

2010-07-21 Thread Howard Rogers
Suppose 1=Red, 2=Yellow, 4=Green and 8=Orange. Now suppose the following data structures and rows exist: create table coloursample (recid integer, colour integer, descript varchar); insert into coloursample values (1,2,'Yellow only'); insert into coloursample values (2,10,'Yellow and Orange'); in

Re: [GENERAL] Full Text Search ideas

2010-07-18 Thread Howard Rogers
On Mon, Jul 19, 2010 at 6:16 AM, Tom Lane wrote: > Howard Rogers writes: >> ims=# select count(*) from search_rm >> where to_tsvector('english', textsearch) @@ to_tsquery('english','bat & >> sb12n'); >> count >> --- >&g

[GENERAL] Full Text Search ideas

2010-07-18 Thread Howard Rogers
I asked recently about a performance problem I'd been having with some full text queries, and got really useful help that pointed me to the root issues. Currently, I'm trying to see if our document search (running on Oracle Text) can be migrated to PostgreSQL, and the reason I asked that earlier qu

Re: [GENERAL] Full Text Search dictionary issues

2010-07-16 Thread Howard Rogers
On Sat, Jul 17, 2010 at 3:14 AM, Tom Lane wrote: > Howard Rogers writes: >> OK, Tom: I did actually account for the number of rows difference >> before I posted, though I accept I didn't show you that. So here goes: >> ... >> Both queries return zero rows. One ta

Re: [GENERAL] Full Text Search dictionary issues

2010-07-16 Thread Howard Rogers
On Fri, Jul 16, 2010 at 10:23 AM, Tom Lane wrote: > Howard Rogers writes: >> I have 10 million rows in a table, with full text index created on one >> of the columns. I submit this query: > >> ims=# select count(*) from search_rm >> ims-# where to_tsvector

[GENERAL] Full Text Search dictionary issues

2010-07-15 Thread Howard Rogers
I have 10 million rows in a table, with full text index created on one of the columns. I submit this query: ims=# select count(*) from search_rm ims-# where to_tsvector('english', textsearch) ims-# @@ to_tsquery('english', 'woman & beach & ball');  count ---    646 (1 row) Time: 107.570 ms ..

Re: [GENERAL] Commit every N rows in PL/pgsql

2010-07-06 Thread Howard Rogers
On 06/03/2010 08:26 AM, Chris Browne wrote: len.wal...@gmail.com (Len Walter) writes: I need to populate a new column in a Postgres 8.3 table. The SQL would be something like "update t set col_c = col_a + col_b". Unfortunately, this table has 110 million rows, so running that query runs out of

Re: [GENERAL] DBI::Oracle problems

2010-07-02 Thread Howard Rogers
On Thu, Jul 1, 2010 at 5:24 AM, David Fetter wrote: > On Wed, Jun 30, 2010 at 10:10:02AM +1000, Howard Rogers wrote: > > I am stumped, despite working on this for a week! I am trying to create a > > 64-bit postgresql 8.4 database server which can retrieve data from > various &

Re: [GENERAL] DBI::Oracle problems

2010-06-30 Thread Howard Rogers
tter wrote: > On Wed, Jun 30, 2010 at 10:10:02AM +1000, Howard Rogers wrote: > > I am stumped, despite working on this for a week! I am trying to create a > > 64-bit postgresql 8.4 database server which can retrieve data from > various > > 64-bit Oracle 10gR2 and 11g

[GENERAL] DBI::Oracle problems

2010-06-29 Thread Howard Rogers
I am stumped, despite working on this for a week! I am trying to create a 64-bit postgresql 8.4 database server which can retrieve data from various 64-bit Oracle 10gR2 and 11gR2 databases. - I have a freshly-installed 64-bit Centos 5.5, no firewall, no SELinux. - I create an oracle user an