Re: [GENERAL] store key name pattern search

2017-04-04 Thread Oleg Bartunov
On Tue, Apr 4, 2017 at 11:41 AM, Armand Pirvu (home) wrote: > Hi > > I have the following case > > > select * from foo; > col1 > > - > "show_id"=>"1", "group_id"=>"32", "group_n

Re: [GENERAL] Incremental / Level -1 backup in PG

2017-03-21 Thread Oleg Bartunov
On Wed, Mar 22, 2017 at 3:27 AM, Rakesh Kumar wrote: > PG does not have a concept of incremental backup. The way it works in > Oracle and other RDBMS is that incremental backup only backups up changed > blocks since the last full backup. So if only 10% of blocks changed since > the last full ba

Re: [GENERAL] Full Text Search combined with Fuzzy

2017-02-27 Thread Oleg Bartunov
On Sun, Feb 26, 2017 at 3:52 PM, Nicolas Paris wrote: > Hello, > > AFAIK there is no built-in way to combine full text search and fuzzy > matching > (https://www.postgresql.org/docs/current/static/fuzzystrmatch.html). > By example, phrase searching with tipos in it. > > First I don't know if post

Re: [GENERAL] Searching array for multiple items

2017-01-25 Thread Oleg Bartunov
On Wed, Jan 25, 2017 at 11:29 AM, Alex Magnum wrote: > Hi, > I can search an array with 1 = ANY('{1,3,4,7}'::int[]) > > I need to check for one or multiple items in the array. > > e.g. '1,7,3' = ANY('{1,3,4,7}'::int[] > > I do need to check if > a) all items exist in the array > b) at least one

Re: [GENERAL] Incorrect information about GIN-index in RUM's docs

2016-11-14 Thread Oleg Bartunov
On Tue, Nov 15, 2016 at 10:37 AM, Andreas Joseph Krogh wrote: > This item isn't valid, is it? > > >- There isn't phrase search with GIN index. This problem relates with >previous problem. It is need position information to perform phrase search. > > RUM being an extention, and having inde

Re: [GENERAL] Trigram is slow when 10m rows

2016-11-13 Thread Oleg Bartunov
.663..346.663 rows=1220793 loops=1) > Index Cond: (title ~~* 'x264'::text) > Planning time: 1.168 ms > Execution time: 1755.944 ms > > > On Sun, Nov 13, 2016 at 10:04 PM, Oleg Bartunov > wrote: > > > > > > On Sun, Nov 13, 2016 at 2:54 PM, Aaron

Re: [GENERAL] Why is this query not using GIN index?

2016-11-13 Thread Oleg Bartunov
using gin(to_tsvector('english', > >>>> 'title')); > > > > You created an index on the text 'title', not on the title column, so > > the index is useless. > > > > Drop the existing index and create this one instead: > >

Re: [GENERAL] Why is this query not using GIN index?

2016-11-13 Thread Oleg Bartunov
On Sun, Nov 13, 2016 at 2:50 PM, Aaron Lewis wrote: > I have a simple table, and a gin index, > > create table mytable(hash char(40), title varchar(500)); > create index name_fts on mytable using gin(to_tsvector('english', > 'title')); > ^ > create unique i

Re: [GENERAL] Trigram is slow when 10m rows

2016-11-13 Thread Oleg Bartunov
On Sun, Nov 13, 2016 at 2:54 PM, Aaron Lewis wrote: > I have a simple table with Trigram index, > > create table mytable(hash char(40), title text); > create index title_trgm_idx on mytable using gin(title gin_trgm_ops); > > When I run a query with 10m rows, it uses the Trigram index, but takes >

Re: [GENERAL] Gin indexes on intarray is fast when value in array does not exists, and slow, when value exists

2016-11-08 Thread Oleg Bartunov
On Tue, Nov 8, 2016 at 8:43 PM, otar shavadze wrote: > I have table with 500 000 rows, I have int[] column "my_array" in this > table, this array column contains minimum 1 and maximum 5 different values. > you didn't show us postgres version. > > I have GIN index on my_array column: > > * "CRE

Re: [GENERAL] ZSON, PostgreSQL extension for compressing JSONB

2016-10-04 Thread Oleg Bartunov
On Tue, Oct 4, 2016 at 4:20 PM, Simon Riggs wrote: > On 30 September 2016 at 16:58, Aleksander Alekseev > wrote: > > > I've just uploaded ZSON extension on GitHub: > > > > https://github.com/afiskon/zson > > > > ZSON learns on your common JSONB documents and creates a dictionary > > with strings

Re: [GENERAL] Results in ERROR: syntax error in tsquery:

2016-09-19 Thread Oleg Bartunov
On Mon, Sep 19, 2016 at 4:19 AM, Oleg Bartunov wrote: > On Mon, Sep 19, 2016 at 3:46 AM, Kiran wrote: >> Dear All, >> >> I have a ts_vector column in question table called weighted_tsv. >> I am trying to search using ts_query as follows >> >> SELECT * >&

Re: [GENERAL] Results in ERROR: syntax error in tsquery:

2016-09-19 Thread Oleg Bartunov
On Mon, Sep 19, 2016 at 3:46 AM, Kiran wrote: > Dear All, > > I have a ts_vector column in question table called weighted_tsv. > I am trying to search using ts_query as follows > > SELECT * > > FROM question > > WHERE weighted_tsv @@ to_tsquery('Hur ofta'); you should use to_tsquery('Hur & ofta')

Re: [GENERAL] Predicting query runtime

2016-09-13 Thread Oleg Bartunov
On Tue, Sep 13, 2016 at 2:54 PM, Istvan Soos wrote: > On Tue, Sep 13, 2016 at 2:06 AM, Vinicius Segalin > wrote: >> 2016-09-12 18:22 GMT-03:00 Istvan Soos : >>> At Heap we have non-trivial complexity in our analytical queries, and >>> some of them can take a long time to complete. We did analyze

[GENERAL] Fwd: [Snowball-discuss] Greek stemmer

2016-08-25 Thread Oleg Bartunov
This is a chance to add default configuration for Greek language if somebody with good knowledge could follow this development. Oleg -- Forwarded message -- From: Oleg Smirnov Date: Thu, Aug 25, 2016 at 5:26 PM Subject: [Snowball-discuss] Greek stemmer To: "snowball-discu." Hi

Re: [GENERAL] Updated RUM-index and support for bigint as part of index

2016-08-25 Thread Oleg Bartunov
Andreas, sorry for delay, it looks like a bug to me, could you please, share your dataset with me, so I could reproduce the behaviour. Regards, Oleg On Sun, Aug 7, 2016 at 11:05 AM, Andreas Joseph Krogh wrote: > På søndag 07. august 2016 kl. 08:27:06, skrev Oleg Bartunov < &g

Re: [GENERAL] Updated RUM-index and support for bigint as part of index

2016-08-06 Thread Oleg Bartunov
On Tue, Aug 2, 2016 at 9:08 PM, Andreas Joseph Krogh wrote: > Hi. > > I see the RUM-index is updated, which is great! > > I wonder, to be able to sort by timestamp one has to create the index like > this: > > > CREATE INDEX rumidx ON origo_email_delivery USING rum (fts_all > rum_tsvector_timesta

Re: [GENERAL] jsonb search

2016-06-28 Thread Oleg Bartunov
On Tue, Jun 28, 2016 at 5:15 PM, Armand Pirvu (home) wrote: > Hi > > In my quest of JSONB querying and searching without having to actually cast > into a text, I found JSQuery > > I do admit my JSONB knowledge shortcoming and I am not a developer but a > DBA. As such some examples would be greatly

Re: [GENERAL] questions about how to implement a gist index

2016-06-27 Thread Oleg Bartunov
On Tue, Jun 28, 2016 at 12:44 AM, Riccardo Vianello wrote: > Hi all, > > I'm trying to contribute some improvements to the implementation of a gist > index that is part of an open source project and it would be really nice if > anyone could help me answer some questions. > > I would like to use di

Re: [GENERAL] Updated RUM?

2016-06-27 Thread Oleg Bartunov
On Fri, Jun 24, 2016 at 2:36 PM, Andreas Joseph Krogh wrote: > Hi. > > @PostgresPro; Will there be any updates to the rum git-repo any time soon? > Sure. > > I understand you're working hard on this, care to share some > vision/roadmap? I'm specifically interested in if RUM will support the sa

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 4:50 PM, Andreas Joseph Krogh wrote: > På fredag 17. juni 2016 kl. 15:47:08, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Fri, Jun 17, 2016 at 3:52 PM, Andreas Joseph Krogh > wrote: >> >> På fredag 17. juni 2016 kl. 13

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 3:52 PM, Andreas Joseph Krogh wrote: > På fredag 17. juni 2016 kl. 13:53:34, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Fri, Jun 17, 2016 at 2:10 PM, Oleg Bartunov > wrote: >> >> >> >> On Fri, Jun

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 2:10 PM, Oleg Bartunov wrote: > > > On Fri, Jun 17, 2016 at 9:32 AM, Andreas Joseph Krogh > wrote: > >> På torsdag 16. juni 2016 kl. 00:50:45, skrev Jeff Janes < >> jeff.ja...@gmail.com>: >> >> On Wed, Jun 15, 2016 at 3:56 A

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 9:32 AM, Andreas Joseph Krogh wrote: > På torsdag 16. juni 2016 kl. 00:50:45, skrev Jeff Janes < > jeff.ja...@gmail.com>: > > On Wed, Jun 15, 2016 at 3:56 AM, Andreas Joseph Krogh > wrote: >> >> Hi. >> >> First; Is this the correct forum to ask questions about the Postgre

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-31 Thread Oleg Bartunov
On Sun, May 29, 2016 at 8:53 PM, Andreas Joseph Krogh wrote: > På søndag 29. mai 2016 kl. 19:49:06, skrev Oleg Bartunov < > obartu...@gmail.com>: > > [snip] >> >> I want to run 9.6 beta in production right now because of this:-) >> > > wait-wait :) We&#

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-30 Thread Oleg Bartunov
On Sun, May 29, 2016 at 12:59 AM, Oleg Bartunov wrote: > > > On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh > wrote: > >> Hi. >> >> Any news about when slides for $subject will be available? >> > > I submitted slides to pgcon site, but it us

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-30 Thread Oleg Bartunov
On Sun, May 29, 2016 at 10:04 PM, Karsten Hilbert wrote: >>> I submitted slides to pgcon site, but it usually takes awhile, so you can >>> download our presentation directly >>> http://www.sai.msu.su/~megera/postgres/talks/pgcon-2016-fts.pdf > > Looking at slide 39 (attached) I get the impression

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-29 Thread Oleg Bartunov
Mdex :) We are open for suggestion. > > :Stefan, co-organizer of Swiss PGDay > > > 2016-05-29 11:29 GMT+02:00 Andreas Joseph Krogh : > >> På lørdag 28. mai 2016 kl. 23:59:55, skrev Oleg Bartunov < >> obartu...@gmail.com>: >> >> >> >> On Th

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-29 Thread Oleg Bartunov
On Sun, May 29, 2016 at 12:29 PM, Andreas Joseph Krogh wrote: > På lørdag 28. mai 2016 kl. 23:59:55, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh > wrote: >> >> Hi. >> >> Any ne

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-28 Thread Oleg Bartunov
On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh wrote: > Hi. > > Any news about when slides for $subject will be available? > I submitted slides to pgcon site, but it usually takes awhile, so you can download our presentation directly http://www.sai.msu.su/~megera/postgres/talks/pgcon-201

Re: [GENERAL] Ascii Elephant for text based protocols - Final

2016-05-16 Thread Oleg Bartunov
On Mon, May 16, 2016 at 2:47 PM, Charles Clavadetscher wrote: > SELECT row_dat FROM elephant ORDER BY row_num; Very good ! Thanks ! -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Insert only table and size of GIN index JSONB field.

2016-05-03 Thread Oleg Bartunov
On Tue, May 3, 2016 at 1:35 PM, Maxim Boguk wrote: > > > On Tue, May 3, 2016 at 8:09 PM, Maxim Boguk wrote: > >> Hi, >> >> I started with empty table with index over >> custom_fields | jsonb >> field >> defined as: >> "idx_learners_custom_fields" gin (custom_fields) >> Globally gin_pending_

Re: [GENERAL] postgresql & Fulltext & ranking & my own functions

2016-05-03 Thread Oleg Bartunov
On Tue, May 3, 2016 at 3:21 PM, Nicolas Paris wrote: > Hello, > > Documentation says : ( > http://www.postgresql.org/docs/9.5/static/textsearch-controls.html#TEXTSEARCH-RANKING > ) > "The built-in ranking functions are only examples. You can write your own > ranking functions and/or combine their

Re: [GENERAL] JSONB performance enhancement for 9.6

2016-05-01 Thread Oleg Bartunov
On Sun, May 1, 2016 at 6:46 AM, Tom Smith wrote: > Hello: > > I'd like to bring this JSONB performance issue again. > Below is a link of MySQL way of storing/retrieving Json key/value > > https://dev.mysql.com/doc/refman/5.7/en/json.html > > Instead of providing column indexing(like GIN for JSONB

Re: [GENERAL] Shrinking TSvectors

2016-04-05 Thread Oleg Bartunov
On Tue, Apr 5, 2016 at 2:37 PM, Howard News wrote: > Hi, > > does anyone have any pointers for shrinking tsvectors > > I have looked at the contents of some of these fields and they contain > many details that are not needed. For example... > > "'+1':935,942 '-0500':72 '-0578':932 '-0667':938 '-2

Re: [GENERAL] MongoDB 3.2 beating Postgres 9.5.1?

2016-03-13 Thread Oleg Bartunov
On Mar 11, 2016 4:40 PM, "Paul Jones" wrote: > > I have been running the EDB benchmark that compares Postgres and MongoDB. > I believe EDB ran it against PG 9.4 and Mongo 2.6. I am running it > against PG 9.5.1 and Mongo 3.2 with WiredTiger storage using 10,000,000 > JSON records generated by the

Re: [GENERAL] Replacement for Oracle Text

2016-02-19 Thread Oleg Bartunov
On Fri, Feb 19, 2016 at 8:28 PM, Josh berkus wrote: > On 02/19/2016 05:49 AM, s d wrote: > >> On 19 February 2016 at 14:19, Bruce Momjian > > wrote: >> >> I wonder if PLPerl could be used to extract the words from a PDF >> document and create a tsvector column fro

Re: [GENERAL] Query plan not updated after dropped index

2016-02-18 Thread Oleg Bartunov
On Thu, Feb 18, 2016 at 11:17 AM, Victor Blomqvist wrote: > Hello! > > We just had a major issue on our databases, after a index was replaced a > user defined function didnt change its query plan to use the new index. At > least this is our theory, since the function in question became much slowe

Re: [GENERAL] pgDay Asia / talks / lightning talks

2016-02-17 Thread Oleg Bartunov
It's pity I miss this conference, since I learned about it too late. On Wed, Feb 17, 2016 at 8:46 AM, Satoshi Nagayasu wrote: > Hi Dan, > > 2016-02-16 20:43 GMT+09:00 Daniel Pocock : > > Is this the place to ask questions about pgDay Asia[1] or is there > > another mailing list for it? The mail

Re: [GENERAL] fast refresh materialized view

2016-02-11 Thread Oleg Bartunov
Похоже на то, что вы понимаете по-русски ! Сообщество примет вашу работу только под лицензией BSD. Если что непонятно, пишите мне. С Уважением, Олег On Thu, Feb 11, 2016 at 7:56 PM, Nguyễn Trần Quốc Vinh wrote: > We would like to contribute to the PostgreSQL community. What can you > recommend

Re: [GENERAL] BSD initdb without ICU support and switch later

2016-01-29 Thread Oleg Bartunov
On Fri, Jan 29, 2016 at 5:46 PM, Maeldron T. wrote: > Hello, > > the ICU patch isn’t ready for PostgreSQL on FreeBSD. > > Is there any risk (more than 0) in executing the initdb without ICU > support and recompiling PostgreSQL later when the ICU patch is ready? I > mean any risk without m

Re: [GENERAL] Using a german affix file for compound words

2016-01-28 Thread Oleg Bartunov
On Thu, Jan 28, 2016 at 6:04 PM, Wolfgang Winkler < wolfgang.wink...@digital-concepts.com> wrote: > Hi! > > We have a problem with importing a compound dictionary file for german. > > I downloaded the files here: > > > http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/dicts/ispell/ispell-germ

Re: [GENERAL] JSONB performance enhancement for 9.6

2016-01-20 Thread Oleg Bartunov
On Wed, Jan 20, 2016 at 4:51 AM, Bruce Momjian wrote: > On Mon, Jan 11, 2016 at 09:01:03PM -0500, Tom Smith wrote: > > Hi, > > > > Congrats on the official release of 9.5 > > > > And I'd like bring up the issue again about if 9.6 would address the > jsonb > > performance issue > > with large numb

Re: [GENERAL] WIP: CoC V4

2016-01-12 Thread Oleg Bartunov
On Tue, Jan 12, 2016 at 7:50 PM, Joshua D. Drake wrote: > Tl;dr; > > * Removed specific examples and reworded #3 to be more concise > > PostgreSQL Global Development Group (PGDG) Code of Conduct (CoC): > > 1. The CoC is to provide community guidelines for creating and enforcing a > safe, respectf

Re: [GENERAL] Code of Conduct: Is it time?

2016-01-10 Thread Oleg Bartunov
On Sun, Jan 10, 2016 at 9:44 PM, Regina Obe wrote: > > On 01/10/2016 08:07 AM, Bill Moran wrote: > > >> So, the purpose of a CoC is twofold: > >> > >> A) Define what "being excellent" means to this particular > >> community. > >> B) Provide a process for how to resolve things when "being > >>

Re: [GENERAL] Code of Conduct: Is it time?

2016-01-05 Thread Oleg Bartunov
On Wed, Jan 6, 2016 at 7:41 AM, Jim Nasby wrote: > On 1/5/16 10:03 PM, John R Pierce wrote: > >> On 1/5/2016 5:31 PM, Jim Nasby wrote: >> >>> IMHO, the real problem here is not simply a CoC, it is that the >>> Postgres community doesn't focus on developing the community itself. >>> The closest we

Re: [GENERAL] json indexing and data types

2015-12-12 Thread Oleg Bartunov
On Wed, Dec 2, 2015 at 11:48 AM, Kaare Rasmussen wrote: > Hi > > As json essentially only has three basic data types, string, int, and > boolean, I wonder how much of this - to index, search, and sort on > unstructured data - is possible. I guess part of the answer would be > 'jsquery and vodka'

Re: [GENERAL] JSON path wild cards?

2015-11-24 Thread Oleg Bartunov
On Tue, Nov 24, 2015 at 12:39 PM, Dennis wrote: > Is there a way to specify a wild card in a json path? > > For example I have the following json doc: > > [ {“a”:1,”b”: [ { “x”: 7,”y”:8,”z”:9} ] }, {“a”:2,”b”: [ { “x”: > 4,”y”:5,”z”:6} ] }, … ] > > How do I write a select clause that can return

Re: [GENERAL] How to speed up pg_trgm / gin index scan

2015-06-22 Thread Oleg Bartunov
Try 9.4 and you'll surprise. 1. GIN has compression 2. GIN has fast scan feature. Oleg On Mon, Jun 22, 2015 at 7:51 AM, Christian Ramseyer wrote: > Hi > > I have a pretty large table with syslog messages. > > It is already partitioned by month, and for a single month I have e.g. > > > DM=# \d+

Re: [GENERAL] [to_tsvector] German Compound Words

2015-05-28 Thread Oleg Bartunov
ts_debug() ? =# select * from ts_debug('english', 'messages'); alias | description | token | dictionaries | dictionary | lexemes ---+-+--++--+-- asciiword | Word, all ASCII | messages | {english_stem} | english_st

Re: [GENERAL] [tsvector] to_tsvector called multiple times

2015-05-26 Thread Oleg Bartunov
You can ask http://snowball.tartarus.org/ for stemmer. Meanwhile, you can have small personal dictionary (before stemmer) with such exceptions, for example, use synonym template system system Oleg On Tue, May 26, 2015 at 11:18 AM, Sven R. Kunze wrote: > Hi everybody, > > the following stemmin

Re: [GENERAL] Grouping By Similarity (using pg_trgm)?

2015-05-22 Thread Oleg Bartunov
Have you seen http://www.sai.msu.su/~megera/postgres/talks/pgcon-2012.pdf ? On Thu, May 14, 2015 at 9:58 PM, Cory Tucker wrote: > [pg version 9.3 or 9.4] > > Suppose I have a simple table: > > create table data ( > my_value TEXT NOT NULL > ); > CREATE INDEX idx_my_value ON data USING gin(my_v

Re: [GENERAL] Find similar records (compare tsvectors)

2015-03-06 Thread Oleg Bartunov
On Fri, Mar 6, 2015 at 5:05 PM, Patrick Dung wrote: > Resend. > > How to quickly compare the similarity of two tsvector? > check http://www.sai.msu.su/~megera/postgres/talks/pgcon-2012.pdf > > On Monday, March 2, 2015 11:01 PM, Patrick Dung > wrote: > > > Hello, > > I had a database with artic

Re: [GENERAL] WAL supported extension

2015-01-18 Thread Oleg Bartunov
On Sun, Jan 18, 2015 at 2:01 PM, Michael Paquier wrote: > Oleg Bartunov wrote: > > We are eager for development of this API. > Yeah, me too actually :) Oleg, are there plans on your side to do > something in this area for 9.6? > Yes, Alexander Korotkov will continue workin

Re: [GENERAL] WAL supported extension

2015-01-18 Thread Oleg Bartunov
On Sun, Jan 18, 2015 at 9:15 AM, Michael Paquier wrote: > On Sat, Jan 17, 2015 at 11:18 PM, Kouhei Sutou wrote: > > (Is this mailing list right mailing list for asking this > > question...?) > Hackers would have been fine as well. > > > Is there any plan to implement PostgreSQL API to implement

Re: [GENERAL] JSONB spaces in text presentation

2014-09-24 Thread Oleg Bartunov
Check slides 17-20 of http://www.sai.msu.su/~megera/postgres/talks/hstore-dublin-2013.pdf to understand, what 'binary format' means. The slides describes binary storage for nested hstore, not jsonb, but you'll get the idea. On Wed, Sep 24, 2014 at 6:22 PM, Seref Arikan wrote: > This is interesti

Re: [GENERAL] jsonb and comparison operators

2014-09-03 Thread Oleg Bartunov
jsquery (https://github.com/akorotkov/jsquery) should works for you. On Wed, Sep 3, 2014 at 8:38 AM, Joe Van Dyk wrote: > Is it possible to get this query (or a similar one) to use an index? > > I want to return all rows that have a value of less than 10. I have > arbitrary keys I want to check

Re: [GENERAL] Force specific index disuse

2014-05-21 Thread Oleg Bartunov
We routinely use plantuner. http://www.sai.msu.su/~megera/wiki/plantuner On Tue, May 20, 2014 at 12:38 PM, Steve Crawford wrote: > Is there a way to force a specific index to be removed from consideration in > planning a single query? > > Specifically, on a 60-million-row table I have an index

Re: [GENERAL] Full-Text Search question

2014-05-13 Thread Oleg Bartunov
Easy, you need to extract text fields from json and construct tsvector from them (use concatenation, for example). On Tue, May 13, 2014 at 7:38 PM, Jesus Rafael Sanchez Medrano wrote: > can postgres do FTS (full text search) on a json column? if possible, please > be so kindd to give some snippet

Re: [GENERAL] Full text: Ispell dictionary

2014-05-07 Thread Oleg Bartunov
btw, take a look on contrib/dict_xsyn, it's more powerful than synonym dictionary. On Sat, May 3, 2014 at 2:26 AM, Tim van der Linden wrote: > Hi Oleg > > Haha, understood! > > Thanks for helping me on this one. > > Cheers > Tim > > > On May 3, 2014 7:24:0

Re: [GENERAL] Manipulating jsonb

2014-05-02 Thread Oleg Bartunov
cluded in the public 9.4 release? > > Andreas > > > On 2 May 2014 21:21, Oleg Bartunov wrote: >> Andreas, >> >> take a look on https://github.com/erthalion/jsonbx. This is a place, >> where all hstore functionality will be eventually ported. See this >> tabl

Re: [GENERAL] Full text: Ispell dictionary

2014-05-02 Thread Oleg Bartunov
Tim, you did answer yourself - don't use ispell :) On Sat, May 3, 2014 at 1:45 AM, Tim van der Linden wrote: > On Fri, 2 May 2014 21:12:56 +0400 > Oleg Bartunov wrote: > > Hi Oleg > > Thanks for the response! > >> Yes, it's normal for ispell dictionary,

Re: [GENERAL] Manipulating jsonb

2014-05-02 Thread Oleg Bartunov
Andreas, take a look on https://github.com/erthalion/jsonbx. This is a place, where all hstore functionality will be eventually ported. See this table - https://gist.github.com/erthalion/10890778 Oleg On Fri, May 2, 2014 at 10:32 PM, Andreas Heiduk wrote: > Hello, > > I'm playing with a 9.4 pre

Re: [GENERAL] Full text: Ispell dictionary

2014-05-02 Thread Oleg Bartunov
Yes, it's normal for ispell dictionary, think about morphological dictionary. On Fri, May 2, 2014 at 11:54 AM, Tim van der Linden wrote: > Good morning/afternoon all > > I am currently writing a few articles about PostgreSQL's full text > capabilities and have a question about the Ispell diction

Re: [GENERAL] hstore - jsonb

2014-04-04 Thread Oleg Bartunov
On Fri, Apr 4, 2014 at 7:17 PM, Thom Brown wrote: > On 4 April 2014 16:15, Oleg Bartunov wrote: >> We'll work on contrib/jsonxtra with all operators ported from hstore >> and release it after 9.4 as separate extension. > > That would be useful. :) > > Would th

Re: [GENERAL] hstore - jsonb

2014-04-04 Thread Oleg Bartunov
We'll work on contrib/jsonxtra with all operators ported from hstore and release it after 9.4 as separate extension. On Fri, Apr 4, 2014 at 4:32 PM, Thom Brown wrote: > On 4 April 2014 13:04, Oleg Bartunov wrote: >> On Fri, Apr 4, 2014 at 12:20 PM, Armand Turpel >> wrote: &

Re: [GENERAL] hstore - jsonb

2014-04-04 Thread Oleg Bartunov
On Fri, Apr 4, 2014 at 12:20 PM, Armand Turpel wrote: > Hi, > > A few questions about jsonb and hstore: > > 1. does jsonb replace hstore? no, it's different data type > 2. compatibility of jsonb <> hstore? hstore is a simple key-value model, while jsonb - richer document-based model. > 3. wil

Re: [GENERAL] Need Help to implement Proximity search feature

2014-01-15 Thread Oleg Bartunov
check knn search, http://www.sai.msu.su/~megera/postgres/talks/pgcon-2010-1.pdf On Wed, Jan 15, 2014 at 8:04 PM, itishree sukla wrote: > Deal all, > > In my project, there is a requirement to implement proximity search feature. > We are running a mobile app, for which proximity search is require.

Re: [GENERAL] [tsearch2] Problem with case sensitivity (or with creating own dictionary)

2013-08-05 Thread Oleg Bartunov
om-dict.html> So now, I have no idea what to do with my case sensitivity problem... Is there any other way to overcome it, apart from creating own dictionary? If no - how to create one on the Postgres 9.2? Regards, xaru Regards, Oleg _

Re: [GENERAL] Analyzing last run query in psql

2013-07-03 Thread Oleg Bartunov
Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: o...@sai.msu.su, http://www.sai.msu.su/~megera/ phone: +007(495)939-16-83, +007(495)939-23-83 -- Sent via pgsql-general mailing list (pgsql-ge

Re: [GENERAL] How to do a full-text search words within some proximity of each other?

2012-09-24 Thread Oleg Bartunov
att Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: o...@sai.msu.su, http://www.sai.msu.su/~megera/ phone: +007(49

Re: [GENERAL] Simplifying the tsvector format for simple glossaries

2012-01-29 Thread Oleg Bartunov
7;d suggest to add a description on this possible tsvector representation to the doc. best regards, Marc Mamin Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg A

Re: [GENERAL] Full Text Search, avoiding lexemes search

2012-01-27 Thread Oleg Bartunov
match only for "gato" and avoid "gatos" "gata" "gatas", with FTS ?? Or match only for "gato" "gatos" buy no for "gata" "gatas"? Tnks! Regards, Oleg ___

Re: [GENERAL] Full text search - How to build a filtering dictionary

2012-01-18 Thread Oleg Bartunov
anks in advance, Antonio Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: o...@sai.msu.su, http://www.sai

Re: [GENERAL] text search synonym dictionary anomaly with numbers

2011-11-27 Thread Oleg Bartunov
txtsrch @@ to_tsquery('first'); count --- 403 <- this is also good SELECT count(*) FROM parcel_attrib WHERE txtsrch @@ to_tsquery('1st'); count --- 4 <- this is not good. There are 4 records that do have '1st', but why am I not getting 403 records? Tha

Re: [GENERAL] Searching for "bare" letters

2011-10-02 Thread Oleg Bartunov
do: store duplicate versions. There's always a way to deal with data the way it is. In my opinion storing different versions of the same data just bloats a database in favor of a smarter way to deal with the initial data. Uwe Regards, Oleg ___

Re: [GENERAL] ts_rank seems very slow (140 ranked documents / second on my machine)

2011-07-13 Thread Oleg Bartunov
Hi Oleg and all, On Wed, Jul 13, 2011 at 08:16, Oleg Bartunov wrote: there is problem with estimating of cost scanning gin index in < 9.1 versions, so you can set enable_seqscan=off; or try 9.1 which beta3 now. I re-ran my queries using enable seqscan=off. Now the first query, without ts_ra

Re: [GENERAL] ts_rank seems very slow (140 ranked documents / second on my machine)

2011-07-12 Thread Oleg Bartunov
On Tue, 12 Jul 2011, Nicolas Grilly wrote: On Tue, Jul 12, 2011 at 22:25, Oleg Bartunov wrote: I don't see your query uses index :) Yes, I know. :) I ran VACUUM ANALYZE and re-ran the query but the output of EXPLAIN ANALYZE stays exactly the same: no index used. Any idea why? the

Re: [GENERAL] ts_rank seems very slow (140 ranked documents / second on my machine)

2011-07-12 Thread Oleg Bartunov
there a way to reduce the execution time? I use PostgreSQL 8.4 with shared_buffers = 256 MB, work_mem = 256 MB. Thanks for your help and advice. Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of As

Re: [GENERAL] simple update query too long

2011-05-13 Thread Oleg Bartunov
to do everything you can to avoid table wide updates (up to and including building a new table instead). merlin Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg A

Re: [GENERAL] full text search to_tsquery performance with ispell dictionary

2011-05-11 Thread Oleg Bartunov
kin Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: o...@sai.msu.su, http://www.sai.msu.su/~megera/ phone: +007(495)9

Re: [GENERAL] GIN index not used

2011-04-28 Thread Oleg Bartunov
5698.n5.nabble.com/GIN-index-not-used-tp4344826p4344826.html Sent from the PostgreSQL - general mailing list archive at Nabble.com. Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.as

Re: [GENERAL] fulltext search and hunspell

2011-02-08 Thread Oleg Bartunov
- asciiword | Word, all ASCII | Schokoladenfabrik | {german_hunspell,german_stem} | german_stem | {schokoladenfabr} (1 row) But it seems that the hunspell dictionary is not working for compound words. Maybe pg_updatedicts has a bug and generates affix files in the wrong format? Jens 201

Re: [GENERAL] fulltext search and hunspell

2011-02-07 Thread Oleg Bartunov
QL) The dict and affix files in the tsearch_data directory were automatically generated by pg_updatedicts. Is this a problem of the splitting compound word functionality? Should I use ispell instead of hunspell? Thanks Regards, Oleg ___

Re: [GENERAL] Full Text Index Scanning

2011-01-29 Thread Oleg Bartunov
rner wrote: Thanks Oleg. I'm going to have to experiment with this so that I understand it better. Matt On Fri, Jan 28, 2011 at 1:12 PM, Oleg Bartunov wrote: Matt, I'd try to use prefix search on original string concatenated with reverse string: Just tried on some spare

Re: [GENERAL] Full Text Index Scanning

2011-01-28 Thread Oleg Bartunov
quot; The reason I want to do this is that the partial word search does not involve dictionary words (it's scanning names). Is this something Postgres can do? Or is there a different way to do scan the index? TIA, Matt Regards, Oleg

Re: [GENERAL] FTS phrase searches

2010-12-20 Thread Oleg Bartunov
On Sun, 19 Dec 2010, Glenn Maynard wrote: 2010/12/19 Oleg Bartunov : You might be interested in http://www.sai.msu.su/~megera/wiki/2009-08-12 Thanks, that looks pretty much like what I had in mind. Hopefully that'll get merged for 9.0+1; phrases are a major part of all text sea

Re: [GENERAL] FTS phrase searches

2010-12-19 Thread Oleg Bartunov
en a phrase restriction should, too.  It's also painful when the FTS column is an aggregate of several other columns (eg. title and body), since a LIKE match needs to know that and check all of them separately. Any hints?  This is pretty important to even simpler search systems.

Re: [GENERAL] FTS GIN Index Question

2010-09-29 Thread Oleg Bartunov
f that size are very welcome. Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: o...@sai.msu.su, http://www.sai.msu.su/~megera/ phone: +007(495)939-16

Re: [GENERAL] Visualize GiST Index

2010-09-27 Thread Oleg Bartunov
tgresql 8.4.4, can you please help us? Paolo & Waqas Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet

Re: [GENERAL] Visualize GiST Index

2010-09-26 Thread Oleg Bartunov
hem to fix that upstream. regards, tom lane Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Rus

Re: [GENERAL] GiN indexes

2010-08-31 Thread Oleg Bartunov
ds only, or can I combine tsvector type field with other type fields in the index, such as a timestamp column? It does both. Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet

Re: [GENERAL] Differences between to_tsquery() and plainto_tsquery() when it comes to applying an index?

2010-08-25 Thread Oleg Bartunov
'Limited Partnership'". btw, Be sure you use the same search configuration as in create index or index will not be used at all. Is this indeed the problem here? The explain output references "val @@ plainto_tsquery()" but as a filter, whereas the tag port

Re: [GENERAL] Differences between to_tsquery() and plainto_tsquery() when it comes to applying an index?

2010-08-25 Thread Oleg Bartunov
Regards, Oleg _____ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astronomical Institute, Moscow University, Russia Internet: o...@sai.msu.su, http://www.sai.msu.su/~megera/ phone: +007(495)939-16-83, +007(495)9

Re: [GENERAL] FTS wildcard and custom ispell dictionary problem

2010-08-19 Thread Oleg Bartunov
uld use :( select to_tsquery('dc2', 'kriev:*') || to_tsquery('english', 'kriev:*'); Thanks Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.as

Re: [GENERAL] FTS wildcard and custom ispell dictionary problem

2010-08-19 Thread Oleg Bartunov
so the search looks for both - kriev:* and krievs:* but anyway didnt figured out any syntax i could use :( Thanks Regards, Oleg _ Oleg Bartunov, Research Scientist, Head of AstroNet (www.astronet.ru), Sternberg Astr

Re: [GENERAL] Need help with full text index configuration

2010-07-29 Thread Oleg Bartunov
| File or path name | five/six | {} | | (3 rows) Is there anyway to do this? Thanks for the help in advance. I'm running 8.4.4 Regards, Oleg _ Oleg Bartunov, Research Scientist, Head

Re: [GENERAL] Incorrect FTS result with GIN index

2010-07-28 Thread Oleg Bartunov
Tom, you can download dump http://mira.sai.msu.su/~megera/tmp/search_tab.dump Oleg On Tue, 27 Jul 2010, Tom Lane wrote: Oleg Bartunov writes: I recommend post your problem to -hackers mailing list. I have no idea, what could be a problem. I wonder whether the problem is not windows versus

Re: [GENERAL] Incorrect FTS result with GIN index

2010-07-24 Thread Oleg Bartunov
to pg-hackers list: http://old.nabble.com/Query-results-differ-depending-on-operating-system-%28using-GIN%29-ts29213082.html As to compiling pg... I will no do this since I do not really feel comfortable doing it and cannot dedicate too much time to this problem. Artur Oleg Bartunov wrote:

Re: [GENERAL] Clarification of the "simple" dictionary

2010-07-22 Thread Oleg Bartunov
Andreas, I'd create myself copy of dictionary to be independent on system changes. Oleg On Thu, 22 Jul 2010, Andreas Joseph Krogh wrote: On 07/22/2010 07:44 PM, Oleg Bartunov wrote: Don't guess, but read docs http://www.postgresql.org/docs/8.4/interactive/textsearch-diction

  1   2   3   4   5   >