[GENERAL] 10 TB database

mostly for generating user requesting reports (aggregating). We would have about 10TB of data in three years. Do you think is it possible to build this with postgresql and have any idea how to start? :) Thanks in advance, Artur -- Sent via pgsql-general mailing list (pgsql-general

Re: [GENERAL] [pg_trgm] Making similarity(?, ?) < ? use an index

it possible to make `similarity` use the index? If not, is there a way to speed up the query above? Best regards -- Greg Navis I help tech companies to scale Heroku-hosted Rails apps. Free, biweekly scalability newsletter for SaaS CEOs <http://www.gregnavis.com/newsletter/> -- Artur Zak

Re: [GENERAL] [pg_trgm] Per-query set_limit()

ility newsletter for SaaS CEOs <http://www.gregnavis.com/newsletter/> -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.o

Re: [GENERAL] [pg_trgm] Making similarity(?, ?) < ? use an index

know functions do not use indexes. Of course I may be wrong. And somebody knows a better solution. On 03.06.2016 14:24, Greg Navis wrote: Artur, thanks for your reply. That's right, `%` does use the index. The goal of using `similarity(lhs, rhs) >= show_limit()` was to replace `show_limit()

Re: [GENERAL] [pg_trgm] Making similarity(?, ?) < ? use an index

ly your plan differs from Tom's proposal. And I am afraid that you will do a waste work. -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http

Re: [GENERAL] [pg_trgm] Making similarity(?, ?) < ? use an index

ance you do not need threshold. > > Thanks for help. > -- > Greg Navis > I help tech companies to scale Heroku-hosted Rails apps. > Free, biweekly scalability newsletter for SaaS CEOs > <http://www.gregnavis.com/newsletter/> > > -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company

Re: [GENERAL] FTS with more than one language in body and with unknown query language?

ictionary. * Any hints to related work where FTS has been used in a multilingual context? :Stefan -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] FTS with more than one language in body and with unknown query language?

Hello, Stefan! On 15.07.2016 01:54, Stefan Keller wrote: приве́т! Artur Thanks for your explanations. 2016-07-14 17:20 GMT+02:00 Artur Zakirov : On 14.07.2016 01:16, Stefan Keller wrote: ... * Should I create a synonym dictionary which contains word translations en-de instead of synonyms

Re: [GENERAL] FTS with more than one language in body and with unknown query language?

://github.com/select-artur/postgres/tree/join_tsconfig It adds new option for FTS dictionary mapping (JOIN). I want to propose this patch to -hackers. - dict_translate dictionary based on dict_xsyn contrib: https://github.com/select-artur/dict_translate This things are made for multilingual

Re: [GENERAL] Updated RUM-index and support for bigint as part of index

e ONE index. > > Will this be supported? > We have a plan to use generic types to able to include bigint, timestamp and other types as part of index. But I cant tell date of it. -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company

Re: [GENERAL] Updated RUM-index and support for bigint as part of index

'andreas') ORDER BY received <=> '2013-01-01' DESC LIMIT 8; id |received | rank +-+-- 6 | 2015-09-29 00:26:56 | 86488016 3 | 2015-08-18 03:49:02 | 82871342 2 | 2015-08-18 03:07:55 | 8286

Re: [GENERAL] FTS query, statistics and planner estimations…

nto_tsquery() with specified configuration should be faster and plainto_tsquery(regconfig,test) is immutable function. -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Incorrect information about GIN-index in RUM's docs

mbiguous. GIN supports it, but it requires additional bitmap heap scan and so it slower. I fixed it. Thank you. -- *Andreas Joseph Krogh* CTO / Partner - Visena AS Mobile: +47 909 56 963 andr...@visena.com <mailto:andr...@visena.com> www.visena.com <https://www.visena.com> <https://w

Re: [GENERAL] Full text search tsv column aproach vs concat confusion

e2 ON table1.table2_id=table2.id ) subquery WHERE subquery.document @@ to_tsquery(unaccent(?)); And specifying a text search configuration makes queries a little bit faster: ... to_tsvector('english', coalesce(table1.col1,'')) ... -- Artur Zakirov Postgres Professional: http

Re: [GENERAL] Install pgAudit extension

USE_PGXS=1 PG_CONFIG=/pg_config install -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Using a german affix file for compound words

select ts_lexize('german_ispell', 'test'); ts_lexize --- {test} (1 row) -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Using a german affix file for compound words

? Did you try a dictionary from http://extensions.openoffice.org/en/project/german-de-de-frami-dictionaries ? You need extract from a downloaded archive de_DE_frami.aff and de_DE_frami.dic files, rename them and convert them to UTF-8. Am 2016-01-28 um 17:34 schrieb Artur Zakirov: On 28.01

Re: [GENERAL] commit time in logical decoding

ou in advance, Kind Regards, Weiping -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Shrinking TSvectors

| english_stem postgres=# \dF+ english_cfg Text search configuration "public.english_cfg" Parser: "pg_catalog.default" Token | Dictionaries -+-- asciihword | english_stem asciiword | english_stem hword | englis

Re: [GENERAL] How to build docs from master?

ttp://www.postgresql.org/docs/devel/static/docguide-toolsets.html Thanks. -- *Andreas Joseph Krogh* CTO / Partner - Visena AS Mobile: +47 909 56 963 andr...@visena.com <mailto:andr...@visena.com> www.visena.com <https://www.visena.com> <https://www.visena.com> -- Artur Zaki

Re: [GENERAL] Question about ranking & full text

often the query terms appear in the document, how close together the terms are in the document, and how important is the part of the document where they occur. In the third example found terms are empty. And the function can't do calculates with empty terms. It sees that the terms a

[GENERAL] How to get fast ~ operator using C locale

"initial environ dump"? Best regards, Artur ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to t

Re: [GENERAL] How to get fast ~ operator using C locale

: LC_MESSAGES=pl_PL.UTF-8 DEBUG: LC_MONETARY=C DEBUG: LC_NUMERIC=C DEBUG: LC_TIME=C So, does it mean that the server does not really use C locale? On 7/5/07, Dimitri Fontaine <[EMAIL PROTECTED]> wrote: Hi, Le jeudi 05 juillet 2007, Artur Rataj a écrit: >

[GENERAL] How to get fast ~ operator using C locale

"initial environ dump"? Best regards, Artur ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq

Re: [GENERAL] Use full text to rank results higher if they are "closer hit"

On 14.02.2017 18:57, Artur Zakirov wrote: Hello, try the query: SELECT s, ts_rank(vector, query) AS rank FROM t, to_tsvector(s) vector, to_tsquery('hello') query WHERE query @@ vector; s | rank -+--- hello | 0.0607927 hello world | 0.03039

Re: [GENERAL] Use full text to rank results higher if they are "closer hit"

or, to_tsquery('hello') query WHERE query @@ vector; s | rank -+--- hello | 0.0607927 hello world | 0.0303964 (2 rows) And read about **normalization** in [1] https://www.postgresql.org/docs/current/static/textsearch-controls.html -- Artur Zakirov Post

Re: [GENERAL] Full Text Search combined with Fuzzy

27;, texts) FROM test_trgm WHERE 'hello word' <% texts; texts | word_similarity ---+- blah blah blah hello world blah blah blah |0.818182 blah blah blah hello word blah blah blah

Re: [GENERAL] Full Text Search combined with Fuzzy

, there is no plans in the near future to add similarity full text search. 1. https://www.postgresql.org/docs/current/static/textsearch-dictionaries.html -- Artur Zakirov Postgres Professional: http://www.postgrespro.com Russian Postgres Company -- Sent via pgsql-general mailing list (pgsql

[GENERAL] Incorrect FTS result with GIN index

uS8snH DDD EWlE1GShhLe8L NENI tuL cgGGInfcBAlLfIO L1S eeIWeAEnILStu AViWNI n IOLLt 0Alih tuWNE L nAGlVSNSDI DDeW BIegfG EeIhL9ELeScELWGAIfN1uIc DnSE eeIWLu9tLNhNEuAt I1BelhGGfLWLS nSWINI eiELgAIG DDLEclV7 IO c Af EeIElfN L4I lE2G cSOLniAWgSVItc ILDN L57BuDfALtSIe-WnGhGIW DDA NE1Lhuee hNILN DD

Re: [GENERAL] Incorrect FTS results with GIN index

I pasted incorrect query in point 5. It should be: 5. MORE DETAILED QUERY WITH INDEX select keywords from search_tab where (to_tsvector('german', keywords ) @@ to_tsquery('german', 'eeI:*')) and (to_tsvector('german', keywords ) @@ to_tsquery('german', 'dd:*'));

Re: [GENERAL] Incorrect FTS results with GIN index

My version of PostgreSQL is 8.4.3. -- View this message in context: http://old.nabble.com/Incorrect-FTS-results-with-GIN-index-tp29172750p29173652.html Sent from the PostgreSQL - general mailing list archive at Nabble.com. -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org)

Re: [GENERAL] Incorrect FTS result with GIN index

Hello Oleg, my results are different. The analysis looks like this (please note the different numbers of rows): Aggregate (cost=104.05..104.06 rows=1 width=0) (actual time=152.133..152.135 rows=1 loops=1) -> Bitmap Heap Scan on search_tab (cost=5.39..103.98 rows=25 width=0) (actual time=76.

Re: [GENERAL] Incorrect FTS result with GIN index

blings: 1 core id : 0 cpu cores : 1 fpu : yes fpu_exception : yes cpuid level : 10 wp : yes flags : fpu de tsc msr pae cx8 apic sep cmov pat clflush acpi mmx fxsr sse sse2 ss ht syscall lm constant_tsc pni cx16 lahf_lm bogomips :

Re: [GENERAL] Incorrect FTS result with GIN index

The CentOS used for testing is a 64-bits version. Artur Dabrowski wrote: > > I tested the same backup on our CentOS 5.4 virtual machine (running on xen > server) and the results are really weird (118 rows, comparing to 116 on > win xp and 123 expected): > > > --

Re: [GENERAL] Incorrect FTS result with GIN index

this problem. Artur Oleg Bartunov wrote: > > Artur, > > I recommend post your problem to -hackers mailing list. I have no idea, > what could be a problem. > > My machine is: > uname -a > Linux mira 2.6.33-020633-generic #020633 SMP Thu Feb 25 10:10:03 UTC 2010 > x8

Re: [GENERAL] Incorrect FTS result with GIN index

thing special, it's just a regular version from postgres' webpage. Best regards Artur Oleg Bartunov wrote: > > Artur, > > you could get much more problems in future. Full text search problem may > be > signature of more general problem with your postgres setup

[GENERAL] Functions in PostgreSQL under Windows

tion/mycommit.a failed: dlopen: Win32 error 193 What is wrong ? Artur [EMAIL PROTECTED] ---(end of broadcast)--- TIP 5: Have you checked our extensive FAQ? http://www.postgresql.org/users-lounge/docs/faq.html