lement some search method which decompress
some chunks of jsonb.
Could you send to me an example of that jsonb?
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general m
toast_decompress_datum
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http
chunks.
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.org
#x27;::jsonb)
Rows Removed by Index Recheck: 4360296
Heap Blocks: exact=37031 lossy=872059
Hmm, looks like too small work_mem because lossy heap block count is too big.
--
Teodor Sigaev E-mail: teo...@sigaev.ru
h
optimization level does cmake buld use by default? Which compiler does it take?
It's not obvious, because cmake build hides actual compiler command line.
Yury, pls, return back check target...
--
Teodor Sigaev
Teodor Sigaev wrote:
I tried it on FreeBSD 64-bit, 16Gb, SSD, Core i7
( ./configure && gmake all; ) 168,99s user 15,46s system 97% cpu 3:09,61 total
( cmake . && gmake all; ) 75,11s user 11,34s system 100% cpu 1:26,30 total
( CFLAGS='-O2' cmake . && gmake
Hm, I don't think having the compile/link lines be hidden up is
acceptable. Many times we need to debug some compile problem, and the
output is mandatory.
+1
Although it could be fixed by
VERBOSE=1 make
--
Teodor Sigaev E-mail: teo...@siga
PostgreSQL
---(end of broadcast)---
TIP 1: if posting/reading through Usenet, please send an appropriate
subscribe-nomail command to [EMAIL PROTECTED] so that your
message can get through to the mailing list cleanly
--
Teo
free space map settings
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 1: if posting/reading through Usenet,
I found out that using 'simple' instead of 'default' when using
to_tsvector() does excactly that, but I don't know how to change my
triggers and indexes to keep doing the same (using 'simple').
Suppose, your database is initialized with C locale. So, just mark
simple configuration as default:
ry and this is effecting the
Warm Standby.
Hmm. I found that gin_xlog_cleanup doesn't reset incomplete_splits list. Is it
possible reason of bug?
Attached patch fixes it.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
vide more details about
your test?
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster
ck on buffer's lock. So, right
now I investigate the problem.
Neither GIST nor B-tree seems to throw an error in corresponding
locations also, so the potential for not being able to track this is
high. I'd want to throw errors in those locations also.
Agreed, I'll add more ch
Found a reason: if parent page is fully backuped after child's split then
forgetIncompleteSplit() isn't called at all.
Hope, attached patch fix that. Pls, test it.
PS I'm going away for weekend, so I'll not be online until Monday.
--
Teodor Sigaev
"ring" of buffers for VACUUM. Nevertheless, it's a possible
scenario in 8.2.
Attached patch fixes that deadlock bug too. And, previous version of my patch
has a mistake which is observable on CREATE INDEX .. USING GIN query.
--
Teodor Sigaev
So,
splits occur rather rare.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 3: Have you checked our extensive
Ooops. Patch doesn't apply cleanly. New version.
Attached patch fixes that deadlock bug too. And, previous version of my
patch has a mistake which is observable on CREATE INDEX .. USING GIN query.
--
Teodor Sigaev E-mail: [EMAIL PROT
ted. Thank for your report and testing.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 9: In versions below 8.0, t
ow to user
void page.
Is a fix being worked on?
If a fix is forthcoming, will it be available in the 8.2 series or only 8.3+?
Possibly, full fix in 8.4. But I will not promise.
8.3 will have protection from queries which doesn't match anything.
--
Teodor Sigaev
a cube (a data type
from the postgres cube extension module).
I traced the error to the gistUserPicksplit
function in the
gistsplit.c ... I surmise that this method is called whenever a page
split is necessary.
So, I know when this error occurs, but I don't know why.
Thoughts anyone?
C
pm');
to_tsvector
---
'httpd-2.2.3-5.src.rpm':1
Why don't I get: 'httpd', 'src', 'rpm', 'httpd-2.2.3-5.src.rpm' ?
Is this a bug or design?
Thank you!
Bob
Regards,
My dictionary at 506 line had:
Where do you take this file? And what is encdoing/locale setting of your db?
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of
led.
!>
Hmm, can you provide backtrace?
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 3: Have you ch
I tryed to reproduce the bug but without success.
Could you provide a dump of text column?
Hannes Dorbath wrote:
Crash happens about 7 minutes after issuing the UPDATE statement with
current CVS HEAD. The table has around 5 million rows. It's always
reproducible.
--
Teodor S
Fixes are committed to CVS, hope, they will help you.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 9: In
x27;ISIMO# tonto tont'isimo
O > -O, 'ISIMA# tonto tont'isima
Current implementation doesn't accept any character in ending except alpha ones.
i think 'I.. word is not correct for ispell,
this should be one Í letter
That's right, but you should convert di
html#TEXTSEARCH-STATISTICS
For versions before 8.3 just use stat() function instead of ts_stat().
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(e
.
In any case, the patch was developed for contrib version of tsearch.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To ma
sion of existing ts_headline.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://ww
/gevel/). GiST-related functions in this
module is invented to help to developers, not for production use, so they
acquire exclusive lock on index.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http
I just stumbled on http://www.cs.purdue.edu/spgist/ which seems like
exactly what I need.
It doesn't work with 8.2 and up, because since 8.2 index should take care about
concurrent access itself and that implementation doesn't do it.
--
Teodor Sigaev
writing my own stemmer in PL/pgSQL or in C as a postgres
function.
Yes, of course, you can develop your dictionary (-ies) and parser. Dut only in
C, because they are critical for performance.
--
Teodor Sigaev E-mail: [
ry per
word. So, if your language can work with C-structures then you can use that
language with tsearch with more or less performance pay. PL/pgSQL hasn't this
capability.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
setext). Method should mark a needed
words/parts/lexemes etc.
4 ts_headline glues fragments into text and returns that.
We need a parser's headline method because only parser knows all about its
lexemes.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
it seems that I should reduce the Fill Factor of some FTS indexes, but
what is the default ?
> The other index methods use fillfactor in different but roughly
analogous ways;
> the default fillfactor varies between methods
Actually, GIN doesn't use it.
--
Te
ntryInsert. ginEntryInsert is called
during pending list cleanup.
Patch removes checking of TOAST_INDEX_TARGET and use checking only by
GinMaxItemSize which is greater than TOAST_INDEX_TARGET. All size's check is now
in GinFormTuple.
--
Te
ppose.
Will you apply this, or do you want me to?
I'm not able to provide a good error message in good English :(
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via pgsql-gener
ues
to an array, but that doesn't seem to work with prefix searching. Any pointers
would be much appreciated!
Thanks,
Albert
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via
uses FTS with Chinese language.
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
SELECT id FROM document WHERE to_tsvector('english',text) @@
plainto_tsquery('english','despite this');
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
made as module, I think.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http
tateAction into
table(s) with some caching for first step) , but it's complex to operate and
it's needed to prove correctness of changes in states before its become in use.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
It *may* be because I'm using psql 8.0.3 and not the latest version (but
I'm stucked with that version), i'm just hoping that one of you have met
Upgrade to 8.0.17 - there was a several fixes in ISpell code.
--
Teodor Sigaev E-mail: [
. Will see.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.postgresql.or
8 rows=640 width=2)
Recheck Cond: (t = 1)
-> Bitmap Index Scan on qqidx (cost=0.00..19.46 rows=640 width=0)
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
Sent via pgsql-genera
nt on table1
(cost=0.00..8.27 rows=1 width=0) (actual time=0.011..0.408 rows=98
loops=1)
Total runtime: 0.477 ms
(3 rows)
--
Regards,
Sergey Konoplev
--
PostgreSQL articles in english & russian
http://gray-hemp.blogspot.com/search/label/postgresql/
--
Teodor Sigaev
Fixed, patch attached.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
diff -c -r src.orig/backend/access/gist/gistget.c
src/backend/access/gist/gistget.c
*** src.orig/backend/access/gist
20 hours to find the fix Teodor, Kudos !
Nothing for the pride :(, my bug.
Due to the importance of the fix, will we see very soon a 8.3.5 ?
Don't known, see discussion. I think, that will make sense.
--
Teodor Sigaev E-mail: [EMAIL PROT
s any [alnum]+-[alnum]+ as a hyphenated word, but 8.3 treats
[digit]+-[digit]+ as two separated numbers.
So, you can play around pre-process texts before indexing or have a look on
regex dictionary (http://vo.astronet.ru/arxiv/dict_regex.html)
--
Teodor Sigae
GIN's build algorithm could use bulk insert of ItemPointers if and only if they
should be inserted on rightmost page (exact piece of code - dataPlaceToPage() in
gindatapage.c, lines 407-427)
I'm not following. Rightmost page of what --- it can't be the whole
index, can it, or the case would ha
sequence scan's history.
GIN's build algorithm could use bulk insert of ItemPointers if and only if they
should be inserted on rightmost page (exact piece of code - dataPlaceToPage() in
gindatapage.c, lines 407-427)
Is any way to force table's scan from t
X fooidx ON foo USING gin (v);
LOG: checkpoints are occurring too frequently (16 seconds apart)
HINT: Consider increasing the configuration parameter "checkpoint_segments".
CREATE INDEX
Time: 14557,750 ms
Again, near to the same time.
--
Teodor Sigaev
We could extend IndexBuildHeapScan's API to support that, but I'm
not quite convinced that this is the issue.
That extension might be useful for bitmap index too to simplify index creation
process.
--
Teodor Sigaev E-mail: [EMAIL
dex at once. Do you know why that's happening?
I suppose, if maintenance_work_mem is rather big then all data of index
accumulates in memory and so it writes at disk at once. With that test's options
size of index is equal to 40Mb.
--
Teodor Sigaev
) effective_cache_size
2) The query
3) Output of EXPLAIN ANALYZE of query
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make
es are not
acceptable for french locale :(
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes
ting of your db
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.po
Thank you for the report, will see on this weekend
Vyacheslav Kalinin wrote:
Hello,
Basically, I started testing prefix matching in FTS and got into
troubles. Self-contained example follows:
--
Teodor Sigaev E-mail: teo...@sigaev.ru
can's strategy.
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make changes to your subscription:
http://www.post
Great, thank you!
I assume this one goes into 8.4.3, right?
Yeah, or apply patch
http://anoncvs.postgresql.org/cvsweb.cgi/pgsql/src/backend/access/gin/ginscan.c?r1=1.25&r2=1.26
--
Teodor Sigaev E-mail: teo...@sigae
select * from FT1IDX_trigger_create();
commit;
function are used since I've 2 triggers actually that I drop and
create.
Is there anything wrong in the above to make this update so slow on
a 2x Xeon 3.2GHz 4GbRAM and a RAID1 [sic] I know it is slow on write.
--
Teodor Sigaev
ns to develop fast_insert_gin patch which now in review
process.
Ivan Sergio Borgonovo wrote:
I've a table that contain a tsvector that is indexed (gin) and
triggers to update the tsvector that should then update the index.
--
Teodor Sigaev E-mail: teo...
No matter if I drop the trigger that update agg content and the fact
that I'm just updating d, postgresql will update the index?
Yes, due to MVCC. Update of row could produce new version (tuple) and new
version should be index as old one.
--
Teodor Sigaev
Could you provide a backtrace? Do you use unchanged norwegian.stop file?
I'm not able to reproduce the bug - postgres just works.
Tommy Gildseth wrote:
While trying to create a new dictionary for use with PostgreSQL text
search, I get a segfault. My Postgres version is 8.3.5
--
Teodor S
tgres
BACKEND_PID and type run in gdb, next, execute CREATE DICTIONARY and type bt in gdb
Teodor Sigaev wrote:
Could you provide a backtrace? Do you use unchanged norwegian.stop file?
I'm not able to reproduce the bug - postgres just works.
Tommy Gildseth wrote:
While trying to create a new dict
I reproduced the bug with a help of Grzegorz's point for 64-bit box. So, patch
is attached and I'm going to commit it
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
*** src/backe
ld be some safety limit for lenght of str,
It's a C-string
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via pgsql-general mailing list (pgsql-general@postgresql.org)
To make change
Tom Lane wrote:
Teodor Sigaev writes:
I reproduced the bug with a help of Grzegorz's point for 64-bit box.
Hmm, seems it's not so much a "64 bit" error as a "signed vs unsigned
char" issue?
Yes, but I don't understand why it worked in 32-bit box.
n't mind, I can raise my
points, and see if anything useful comes out of it.
If you see bug/mistake/suspicious point, please, don't be quiet
Also, about that patch - it doesn't seem to apply cleanly to 8.4,
perhaps that file has changed too much (I based my 'review' ab
char" issue? Does this affect the old contrib/tsearch2 code?
Checked - No, that was improvement for 8.3 :).
--
Teodor Sigaev E-mail: teo...@sigaev.ru
WWW: http://www.sigaev.ru/
--
Sent via pgsql-ge
I tried to create an index including all of the fields I query on to
see if that would work, but I get an error the the index row is too
large:
=> create index master_index on source_listings(geo_lat, geo_lon,
price, bedrooms, region, city, listing_type, to_tsvector('english',
full_listing), p
n test3 using gist (a,b);
CREATE INDEX
fl=# create index idx_text_geom on test3 using gist (a,the_geom);
CREATE INDEX
fl=#
Is a sessionid from user_point_features table unique?
Pls, try to compile database with --enable-cassert --enable-debug and send gdb
output.
--
Teodor Sigaev
if your joining column's datatypes do not
match
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster
ith "invalid" tuples
(possibly occured after crash recovery), so itsn't a big deal to add support
NULL in a first column. But freeze date is outdated... Should I add or leave it
to 8.2?
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
.2 and 8.0.3 of Portgresql the
return type is "void".
Help-me, please.
--
William Leite Araújo
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 5: don't forget to increase your free space map settings
Fixed and commited in cvs.
Patches for already existsing versions :
http://www.sigaev.ru/gist/patch_snowball-7.4.gz
http://www.sigaev.ru/gist/patch_snowball-8.0.gz
I'm trying compile a new brazilian portuguese dictionary to TSearch2
contrib, but found the errors:
--
Teodor S
rge data
set. The limit is about 10^5 - 10^6 rows in practice.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster
tuples in database( including frequence location)?
Tsearch2 use "direct" index: each leaf tuple in tree represent document,
internal tuples represents union of documents.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
Look at contrib/pg_trgm. If you want fulltext search with mispelling correction
then read "Tsearch2 Integration" in contrib/pg_trgm/README.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://
shed row to correct value.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster
section. So you can make UTF
parser for german.
BUT, I'm afraid that Snowball uses widechar, and postgres use multibyte for UTF
internally.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://w
isions, perl's hash
function - 35, pgsql's hash_any - 12.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster
gresql
but also
bostgresql, posdgresql, bosdgresql
Is this possible?
Regrads
michael
---(end of broadcast)---
TIP 6: explain analyze is your friend
--
Teodor Sigaev E-mail: [EMAIL
For the others (bostgresql, posdgresql, bosdgresql) i think u should
write a function, that's what we did in our application.
contrib/pg_trgm solves it
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW:
m the
source code (I'm not too much into C/C++)?
Thank you,
Yannick
---(end of broadcast)---
TIP 4: Have you searched our list archives?
http://archives.postgresql.org
--
Teodor Sigaev E-ma
I am running into this limitation ALOT with Tsearch2. What are my
options to get around it. Do I have to compile PostgreSQL with a
different block size?
If yes, what are the downsides to doing so (outside of not being able to
do straight upgrades)?
If you really need that, your should play arou
For example, redefine by follow way:
typedef struct
{
uint32
haspos:1,
len:31;
uint32 pos;
} WordEntry;
/* <= 1Gb */
#define MAXSTRLEN ( 1<<30 )
#define MAXSTRPOS ( 1<<30 )
Teodor Sigaev wrote:
I am running into this limitation ALO
om build?
Can you send exact error message?
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 4: Have you se
(http://webglimpse.net/pubs/TR93-33.pdf). It's pretty
close to trigrams and metrics of similarity is the same, but uses another
signature calculations. And, there are some tips and trics: removing HTML
marking,removing punctuation, lowercasing text and so on - it'
es:
Time of search in GIN weak depend on number of words (opposite to
tsearch2/GiST), but insertion of row may be slow enough
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
search2(idxfti, name, keywords, keywords_cb, location_country,
location_city, media_source, description, euits, site_user);
site_user is a table, isn't it?
tsearch2 trigger accepts only column's names and functions with prototype TEXT
func(TEXT).
For clarify, show yo
r aggregate doesn't support it.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast)---
TIP 9: In versions below 8.0, the
text_ops';
opcname | oprname | amopreqcheck
---+-+--
_text_ops | && | f
_text_ops | @> | f
_text_ops | <@ | t
_text_ops | = | t
(4 rows)
So, operations <@ and = will recheck result with table's row.
Pls, why don't you use tsearch2 with GIN?
earch2 with GIN?
Perhaps -- is there any documentation on this?
Nothing special, just use GIN index instead of GiST.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---
#ifdef PG_MODULE_MAGIC
PG_MODULE_MAGIC;
#endif
solves your problem
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://www.sigaev.ru/
---(end of broadcast
f functional indexes? Is there
another way to achieve
Any help is greatly
appreciated.
Yours,
Alexander Presber
---(end of broadcast)---
TIP 3: Have you checked our extensive FAQ?
http://www.postgresql.org/docs/faq
--
Teodor Sig
word (and a language id) and returns true
if spelled correctly false otherwise.
Thanks.
Balazs
---(end of broadcast)---
TIP 3: Have you checked our extensive FAQ?
http://www.postgresql.org/docs/faq
--
Teodor Sigaev
d bug in code?
if i can provide you with more information - please tell me what i
should tell you.
depesz
--
http://www.depesz.com/ - nowy, lepszy depesz
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
W
about your hardware? myoff in ginDeletePage() and offset in
PageDeletePostingItem are the same variable...
Pls, send to me postgres file itself - just core isn't very useful for debug.
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
I reproduce a problem with small script:
print <5000 and i<40;
VACUUM FULL ANALYZE qq;
EOT
So, I'm digging now...
--
Teodor Sigaev E-mail: [EMAIL PROTECTED]
WWW: http://ww
1 - 100 of 176 matches
Mail list logo
