Re: [GENERAL] store key name pattern search

2017-04-04 Thread Oleg Bartunov
On Tue, Apr 4, 2017 at 11:41 AM, Armand Pirvu (home) wrote: > Hi > > I have the following case > > > select * from foo; > col1 > > - > "show_id"=>"1", "group_id"=>"32", "group_n

Re: [GENERAL] Incremental / Level -1 backup in PG

2017-03-21 Thread Oleg Bartunov
On Wed, Mar 22, 2017 at 3:27 AM, Rakesh Kumar wrote: > PG does not have a concept of incremental backup. The way it works in > Oracle and other RDBMS is that incremental backup only backups up changed > blocks since the last full backup. So if only 10% of blocks changed since > the last full ba

Re: [GENERAL] Full Text Search combined with Fuzzy

2017-02-27 Thread Oleg Bartunov
On Sun, Feb 26, 2017 at 3:52 PM, Nicolas Paris wrote: > Hello, > > AFAIK there is no built-in way to combine full text search and fuzzy > matching > (https://www.postgresql.org/docs/current/static/fuzzystrmatch.html). > By example, phrase searching with tipos in it. > > First I don't know if post

Re: [GENERAL] Searching array for multiple items

2017-01-25 Thread Oleg Bartunov
On Wed, Jan 25, 2017 at 11:29 AM, Alex Magnum wrote: > Hi, > I can search an array with 1 = ANY('{1,3,4,7}'::int[]) > > I need to check for one or multiple items in the array. > > e.g. '1,7,3' = ANY('{1,3,4,7}'::int[] > > I do need to check if > a) all items exist in the array > b) at least one

Re: [GENERAL] Incorrect information about GIN-index in RUM's docs

2016-11-14 Thread Oleg Bartunov
On Tue, Nov 15, 2016 at 10:37 AM, Andreas Joseph Krogh wrote: > This item isn't valid, is it? > > >- There isn't phrase search with GIN index. This problem relates with >previous problem. It is need position information to perform phrase search. > > RUM being an extention, and having inde

Re: [GENERAL] Trigram is slow when 10m rows

2016-11-13 Thread Oleg Bartunov
On Sun, Nov 13, 2016 at 5:25 PM, Aaron Lewis wrote: > Thanks Oleg. > > I've increased work_mem to 128MB, now the query falls down to 1.7s, > faster but still not good enough. > > Is there any other thing I can do about it? > your query 'x264' is short in

Re: [GENERAL] Why is this query not using GIN index?

2016-11-13 Thread Oleg Bartunov
Index Cond: (to_tsvector('english'::regconfig, title) > @@ '''x264'''::tsquery) > Planning time: 0.144 ms > Execution time: 537.212 ms > (9 rows) > > On Sun, Nov 13, 2016 at 10:33 PM, Julien Rouhaud > wrote: > > On 13/11/20

Re: [GENERAL] Why is this query not using GIN index?

2016-11-13 Thread Oleg Bartunov
On Sun, Nov 13, 2016 at 2:50 PM, Aaron Lewis wrote: > I have a simple table, and a gin index, > > create table mytable(hash char(40), title varchar(500)); > create index name_fts on mytable using gin(to_tsvector('english', > 'title')); > ^ > create unique i

Re: [GENERAL] Trigram is slow when 10m rows

2016-11-13 Thread Oleg Bartunov
On Sun, Nov 13, 2016 at 2:54 PM, Aaron Lewis wrote: > I have a simple table with Trigram index, > > create table mytable(hash char(40), title text); > create index title_trgm_idx on mytable using gin(title gin_trgm_ops); > > When I run a query with 10m rows, it uses the Trigram index, but takes >

Re: [GENERAL] Gin indexes on intarray is fast when value in array does not exists, and slow, when value exists

2016-11-08 Thread Oleg Bartunov
On Tue, Nov 8, 2016 at 8:43 PM, otar shavadze wrote: > I have table with 500 000 rows, I have int[] column "my_array" in this > table, this array column contains minimum 1 and maximum 5 different values. > you didn't show us postgres version. > > I have GIN index on my_array column: > > * "CRE

Re: [GENERAL] ZSON, PostgreSQL extension for compressing JSONB

2016-10-04 Thread Oleg Bartunov
> Memory is saved as well. For more details see README.md. > > > > Please don't hesitate to ask any questions. Any feedback and pull > > requests are welcome too! > > Very good. Oleg had mentioned that dictionary compression was being > considered. > > It woul

Re: [GENERAL] Results in ERROR: syntax error in tsquery:

2016-09-19 Thread Oleg Bartunov
On Mon, Sep 19, 2016 at 4:19 AM, Oleg Bartunov wrote: > On Mon, Sep 19, 2016 at 3:46 AM, Kiran wrote: >> Dear All, >> >> I have a ts_vector column in question table called weighted_tsv. >> I am trying to search using ts_query as follows >> >> SELECT * >&

Re: [GENERAL] Results in ERROR: syntax error in tsquery:

2016-09-19 Thread Oleg Bartunov
On Mon, Sep 19, 2016 at 3:46 AM, Kiran wrote: > Dear All, > > I have a ts_vector column in question table called weighted_tsv. > I am trying to search using ts_query as follows > > SELECT * > > FROM question > > WHERE weighted_tsv @@ to_tsquery('Hur ofta'); you should use to_tsquery('Hur & ofta')

Re: [GENERAL] Predicting query runtime

2016-09-14 Thread Oleg Ivanov
rrent results completed in the early October. -- Oleg Ivanov Postgres Professional: http://www.postgrespro.com <http://www.postgrespro.com/> The Russian Postgres Company On 09/12/2016 05:03 PM, Vinicius Segalin wrote: Hi everyone, I'm trying to find a way to predict query runtime

Re: [GENERAL] Predicting query runtime

2016-09-13 Thread Oleg Bartunov
On Tue, Sep 13, 2016 at 2:54 PM, Istvan Soos wrote: > On Tue, Sep 13, 2016 at 2:06 AM, Vinicius Segalin > wrote: >> 2016-09-12 18:22 GMT-03:00 Istvan Soos : >>> At Heap we have non-trivial complexity in our analytical queries, and >>> some of them can take a long time to complete. We did analyze

[GENERAL] Fwd: [Snowball-discuss] Greek stemmer

2016-08-25 Thread Oleg Bartunov
This is a chance to add default configuration for Greek language if somebody with good knowledge could follow this development. Oleg -- Forwarded message -- From: Oleg Smirnov Date: Thu, Aug 25, 2016 at 5:26 PM Subject: [Snowball-discuss] Greek stemmer To: "snowball-

Re: [GENERAL] Updated RUM-index and support for bigint as part of index

2016-08-25 Thread Oleg Bartunov
Andreas, sorry for delay, it looks like a bug to me, could you please, share your dataset with me, so I could reproduce the behaviour. Regards, Oleg On Sun, Aug 7, 2016 at 11:05 AM, Andreas Joseph Krogh wrote: > På søndag 07. august 2016 kl. 08:27:06, skrev Oleg Bartunov < &g

Re: [GENERAL] Updated RUM-index and support for bigint as part of index

2016-08-06 Thread Oleg Bartunov
On Tue, Aug 2, 2016 at 9:08 PM, Andreas Joseph Krogh wrote: > Hi. > > I see the RUM-index is updated, which is great! > > I wonder, to be able to sort by timestamp one has to create the index like > this: > > > CREATE INDEX rumidx ON origo_email_delivery USING rum (fts_all > rum_tsvector_timesta

Re: [GENERAL] jsonb search

2016-06-28 Thread Oleg Bartunov
On Tue, Jun 28, 2016 at 5:15 PM, Armand Pirvu (home) wrote: > Hi > > In my quest of JSONB querying and searching without having to actually cast > into a text, I found JSQuery > > I do admit my JSONB knowledge shortcoming and I am not a developer but a > DBA. As such some examples would be greatly

Re: [GENERAL] questions about how to implement a gist index

2016-06-27 Thread Oleg Bartunov
On Tue, Jun 28, 2016 at 12:44 AM, Riccardo Vianello wrote: > Hi all, > > I'm trying to contribute some improvements to the implementation of a gist > index that is part of an open source project and it would be really nice if > anyone could help me answer some questions. > > I would like to use di

Re: [GENERAL] Updated RUM?

2016-06-27 Thread Oleg Bartunov
On Fri, Jun 24, 2016 at 2:36 PM, Andreas Joseph Krogh wrote: > Hi. > > @PostgresPro; Will there be any updates to the rum git-repo any time soon? > Sure. > > I understand you're working hard on this, care to share some > vision/roadmap? I'm specifically interested in if RUM will support the sa

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 4:50 PM, Andreas Joseph Krogh wrote: > På fredag 17. juni 2016 kl. 15:47:08, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Fri, Jun 17, 2016 at 3:52 PM, Andreas Joseph Krogh > wrote: >> >> På fredag 17. juni 2016 kl. 13

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 3:52 PM, Andreas Joseph Krogh wrote: > På fredag 17. juni 2016 kl. 13:53:34, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Fri, Jun 17, 2016 at 2:10 PM, Oleg Bartunov > wrote: >> >> >> >> On Fri, Jun

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
On Fri, Jun 17, 2016 at 2:10 PM, Oleg Bartunov wrote: > > > On Fri, Jun 17, 2016 at 9:32 AM, Andreas Joseph Krogh > wrote: > >> På torsdag 16. juni 2016 kl. 00:50:45, skrev Jeff Janes < >> jeff.ja...@gmail.com>: >> >> On Wed, Jun 15, 2016 at 3:56 A

Re: [GENERAL] Question about RUM-index

2016-06-17 Thread Oleg Bartunov
the correct forum to ask questions about the Postgres >> Pro's new RUM-index? >> >> If not, please point me to the right forum. >> > > I think that https://github.com/postgrespro/rum/issues might be the best > forum. > > > Oleg and friends; Should we us

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-31 Thread Oleg Bartunov
On Sun, May 29, 2016 at 8:53 PM, Andreas Joseph Krogh wrote: > På søndag 29. mai 2016 kl. 19:49:06, skrev Oleg Bartunov < > obartu...@gmail.com>: > > [snip] >> >> I want to run 9.6 beta in production right now because of this:-) >> > > wait-wait :) We&#

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-30 Thread Oleg Bartunov
On Sun, May 29, 2016 at 12:59 AM, Oleg Bartunov wrote: > > > On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh > wrote: > >> Hi. >> >> Any news about when slides for $subject will be available? >> > > I submitted slides to pgcon site, but it us

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-30 Thread Oleg Bartunov
On Sun, May 29, 2016 at 10:04 PM, Karsten Hilbert wrote: >>> I submitted slides to pgcon site, but it usually takes awhile, so you can >>> download our presentation directly >>> http://www.sai.msu.su/~megera/postgres/talks/pgcon-2016-fts.pdf > > Looking at slide 39 (attached) I get the impression

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-29 Thread Oleg Bartunov
Mdex :) We are open for suggestion. > > :Stefan, co-organizer of Swiss PGDay > > > 2016-05-29 11:29 GMT+02:00 Andreas Joseph Krogh : > >> På lørdag 28. mai 2016 kl. 23:59:55, skrev Oleg Bartunov < >> obartu...@gmail.com>: >> >> >> >> On Th

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-29 Thread Oleg Bartunov
On Sun, May 29, 2016 at 12:29 PM, Andreas Joseph Krogh wrote: > På lørdag 28. mai 2016 kl. 23:59:55, skrev Oleg Bartunov < > obartu...@gmail.com>: > > > > On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh > wrote: >> >> Hi. >> >> Any ne

Re: [GENERAL] Slides for PGCon2016; "FTS is dead ? Long live FTS !"

2016-05-28 Thread Oleg Bartunov
On Thu, May 26, 2016 at 11:26 PM, Andreas Joseph Krogh wrote: > Hi. > > Any news about when slides for $subject will be available? > I submitted slides to pgcon site, but it usually takes awhile, so you can download our presentation directly http://www.sai.msu.su/~megera/postgres/talks/pgcon-201

Re: [GENERAL] Ascii Elephant for text based protocols - Final

2016-05-16 Thread Oleg Bartunov
On Mon, May 16, 2016 at 2:47 PM, Charles Clavadetscher wrote: > SELECT row_dat FROM elephant ORDER BY row_num; Very good ! Thanks ! -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-general

Re: [GENERAL] Insert only table and size of GIN index JSONB field.

2016-05-03 Thread Oleg Bartunov
On Tue, May 3, 2016 at 1:35 PM, Maxim Boguk wrote: > > > On Tue, May 3, 2016 at 8:09 PM, Maxim Boguk wrote: > >> Hi, >> >> I started with empty table with index over >> custom_fields | jsonb >> field >> defined as: >> "idx_learners_custom_fields" gin (custom_fields) >> Globally gin_pending_

Re: [GENERAL] postgresql & Fulltext & ranking & my own functions

2016-05-03 Thread Oleg Bartunov
On Tue, May 3, 2016 at 3:21 PM, Nicolas Paris wrote: > Hello, > > Documentation says : ( > http://www.postgresql.org/docs/9.5/static/textsearch-controls.html#TEXTSEARCH-RANKING > ) > "The built-in ranking functions are only examples. You can write your own > ranking functions and/or combine their

Re: [GENERAL] JSONB performance enhancement for 9.6

2016-05-01 Thread Oleg Bartunov
On Sun, May 1, 2016 at 6:46 AM, Tom Smith wrote: > Hello: > > I'd like to bring this JSONB performance issue again. > Below is a link of MySQL way of storing/retrieving Json key/value > > https://dev.mysql.com/doc/refman/5.7/en/json.html > > Instead of providing column indexing(like GIN for JSONB

Re: [GENERAL] Shrinking TSvectors

2016-04-05 Thread Oleg Bartunov
On Tue, Apr 5, 2016 at 2:37 PM, Howard News wrote: > Hi, > > does anyone have any pointers for shrinking tsvectors > > I have looked at the contents of some of these fields and they contain > many details that are not needed. For example... > > "'+1':935,942 '-0500':72 '-0578':932 '-0667':938 '-2

Re: [GENERAL] MongoDB 3.2 beating Postgres 9.5.1?

2016-03-13 Thread Oleg Bartunov
On Mar 11, 2016 4:40 PM, "Paul Jones" wrote: > > I have been running the EDB benchmark that compares Postgres and MongoDB. > I believe EDB ran it against PG 9.4 and Mongo 2.6. I am running it > against PG 9.5.1 and Mongo 3.2 with WiredTiger storage using 10,000,000 > JSON records generated by the

Re: [GENERAL] Replacement for Oracle Text

2016-02-19 Thread Oleg Bartunov
On Fri, Feb 19, 2016 at 8:28 PM, Josh berkus wrote: > On 02/19/2016 05:49 AM, s d wrote: > >> On 19 February 2016 at 14:19, Bruce Momjian > > wrote: >> >> I wonder if PLPerl could be used to extract the words from a PDF >> document and create a tsvector column fro

Re: [GENERAL] Query plan not updated after dropped index

2016-02-18 Thread Oleg Bartunov
On Thu, Feb 18, 2016 at 11:17 AM, Victor Blomqvist wrote: > Hello! > > We just had a major issue on our databases, after a index was replaced a > user defined function didnt change its query plan to use the new index. At > least this is our theory, since the function in question became much slowe

Re: [GENERAL] pgDay Asia / talks / lightning talks

2016-02-17 Thread Oleg Bartunov
It's pity I miss this conference, since I learned about it too late. On Wed, Feb 17, 2016 at 8:46 AM, Satoshi Nagayasu wrote: > Hi Dan, > > 2016-02-16 20:43 GMT+09:00 Daniel Pocock : > > Is this the place to ask questions about pgDay Asia[1] or is there > > another mailing list for it? The mail

Re: [GENERAL] fast refresh materialized view

2016-02-11 Thread Oleg Bartunov
Похоже на то, что вы понимаете по-русски ! Сообщество примет вашу работу только под лицензией BSD. Если что непонятно, пишите мне. С Уважением, Олег On Thu, Feb 11, 2016 at 7:56 PM, Nguyễn Trần Quốc Vinh wrote: > We would like to contribute to the PostgreSQL community. What can you > recommend

Re: [GENERAL] BSD initdb without ICU support and switch later

2016-01-29 Thread Oleg Bartunov
On Fri, Jan 29, 2016 at 5:46 PM, Maeldron T. wrote: > Hello, > > the ICU patch isn’t ready for PostgreSQL on FreeBSD. > > Is there any risk (more than 0) in executing the initdb without ICU > support and recompiling PostgreSQL later when the ICU patch is ready? I > mean any risk without m

Re: [GENERAL] Using a german affix file for compound words

2016-01-28 Thread Oleg Bartunov
On Thu, Jan 28, 2016 at 6:04 PM, Wolfgang Winkler < wolfgang.wink...@digital-concepts.com> wrote: > Hi! > > We have a problem with importing a compound dictionary file for german. > > I downloaded the files here: > > > http://www.sai.msu.su/~megera/postgres/gist/tsearch/V2/dicts/ispell/ispell-germ

Re: [GENERAL] JSONB performance enhancement for 9.6

2016-01-20 Thread Oleg Bartunov
On Wed, Jan 20, 2016 at 4:51 AM, Bruce Momjian wrote: > On Mon, Jan 11, 2016 at 09:01:03PM -0500, Tom Smith wrote: > > Hi, > > > > Congrats on the official release of 9.5 > > > > And I'd like bring up the issue again about if 9.6 would address the > jsonb > > performance issue > > with large numb

Re: [GENERAL] Data Packaging/Data Unpacking

2016-01-13 Thread oleg yusim
Kevin, It is understood. But doesn't change things from my perspective. It would anyway be user, with sole access, nobody can elevate privileges to and only root can su to. The name, in that case, is irrelevant, but answer postgres gave me idea of the protection level here. Thanks, Oleg O

Re: [GENERAL] Data Packaging/Data Unpacking

2016-01-13 Thread oleg yusim
the system protects data, terminating any process which tries to obtain data from another process - provided data were not shared to begin with). Thanks a lot for your consultation guys. Oleg On Wed, Jan 13, 2016 at 3:49 PM, David G. Johnston < david.g.johns...@gmail.com> wrote: > On Wed

Re: [GENERAL] Data Packaging/Data Unpacking

2016-01-13 Thread oleg yusim
OK, Kevin, David, Thanks you very much for explanation. Now who is the owner of this process? My understanding is, data then located physically in RAM, in the memory stack assigned by OS to this process. Now the question is who owns the process? Thanks, Oleg On Wed, Jan 13, 2016 at 3:29 PM

Re: [GENERAL] Data Packaging/Data Unpacking

2016-01-13 Thread oleg yusim
n: we are about to send results of SELECT statement over the OpenSSL tunnel. Where are the data, physically, between the moment DB engine returned results for my query and moment the package was encrypted by OpenSSL? Thanks, Oleg On Wed, Jan 13, 2016 at 2:46 PM, Kevin Grittner wrote: > On Tue

[GENERAL] Fwd: Data Packaging/Data Unpacking

2016-01-13 Thread oleg yusim
Appologies, for posting it again, but I didn't get any responses so far. Looks like I posted it too late in the evening and it went not noticed. Oleg -- Forwarded message -- From: oleg yusim Date: Tue, Jan 12, 2016 at 10:00 PM Subject: Data Packaging/Data Unpacki

[GENERAL] Data Packaging/Data Unpacking

2016-01-12 Thread oleg yusim
must leverage protection mechanisms. Thanks, Oleg

Re: [GENERAL] WIP: CoC V4

2016-01-12 Thread Oleg Bartunov
On Tue, Jan 12, 2016 at 7:50 PM, Joshua D. Drake wrote: > Tl;dr; > > * Removed specific examples and reworded #3 to be more concise > > PostgreSQL Global Development Group (PGDG) Code of Conduct (CoC): > > 1. The CoC is to provide community guidelines for creating and enforcing a > safe, respectf

Re: [GENERAL] Code of Conduct: Is it time?

2016-01-10 Thread Oleg Bartunov
On Sun, Jan 10, 2016 at 9:44 PM, Regina Obe wrote: > > On 01/10/2016 08:07 AM, Bill Moran wrote: > > >> So, the purpose of a CoC is twofold: > >> > >> A) Define what "being excellent" means to this particular > >> community. > >> B) Provide a process for how to resolve things when "being > >>

Re: [GENERAL] Code of Conduct: Is it time?

2016-01-05 Thread Oleg Bartunov
On Wed, Jan 6, 2016 at 7:41 AM, Jim Nasby wrote: > On 1/5/16 10:03 PM, John R Pierce wrote: > >> On 1/5/2016 5:31 PM, Jim Nasby wrote: >> >>> IMHO, the real problem here is not simply a CoC, it is that the >>> Postgres community doesn't focus on developing the community itself. >>> The closest we

Re: [GENERAL] Failing to known state

2016-01-05 Thread oleg yusim
Hi Adrian, Thank you very much for that link. It confirms what JD and John said, plus explains couple other moments to me. Thanks, Oleg On Tue, Jan 5, 2016 at 7:04 PM, Adrian Klaver wrote: > On 01/05/2016 04:12 PM, oleg yusim wrote: > > Hi Adrian, > > > > I meant a s

Re: [GENERAL] Failing to known state

2016-01-05 Thread oleg yusim
Hi Joe, Exactly how I marked it :) Thanks, Oleg On Tue, Jan 5, 2016 at 6:50 PM, Joe Conway wrote: > On 01/05/2016 04:32 PM, John R Pierce wrote: > > On 1/5/2016 4:12 PM, oleg yusim wrote: > >> I meant a scenario, when user is trying to connect to database > >> (do

Re: [GENERAL] Failing to known state

2016-01-05 Thread oleg yusim
John, Thanks, what you are saying makes sense. I agree, it would cause all user to go through authentication/authorization loop all over and terminate all running transactions too. Thanks, Oleg On Tue, Jan 5, 2016 at 6:32 PM, John R Pierce wrote: > On 1/5/2016 4:12 PM, oleg yusim wr

Re: [GENERAL] Failing to known state

2016-01-05 Thread oleg yusim
e can potentially encounter the situation when database fails into state where user is given greater privileges than he/she should or even authenticated, when he/she shouldn't. Thanks, Oleg On Tue, Jan 5, 2016 at 5:34 PM, Adrian Klaver wrote: > On 01/05/2016 03:21 PM, oleg yusim wrote: &

Re: [GENERAL] Failing to known state

2016-01-05 Thread oleg yusim
Thanks JD. Let me confirm I got you right. So, by exception you mean the authentication/authorization/validation functions would return false in case of DB failure? Thanks, Oleg On Tue, Jan 5, 2016 at 5:33 PM, Joshua D. Drake wrote: > On 01/05/2016 03:21 PM, oleg yusim wrote: > >&g

Re: [GENERAL] Failing to known state

2016-01-05 Thread oleg yusim
sing. If security controls can throw exceptions, they must be very clear about exactly what that condition means. " Right? Thanks, Oleg On Tue, Jan 5, 2016 at 5:14 PM, Joshua D. Drake wrote: > On 01/05/2016 03:09 PM, oleg yusim wrote: > > >> >> The question here, what is Po

[GENERAL] Failing to known state

2016-01-05 Thread oleg yusim
d the description of the way PostgreSQL fails in this regard, but didn't find much. Thanks, Oleg

Re: [GENERAL] Shared system resources

2015-12-23 Thread oleg yusim
Thank you very much George, that is exactly the piece of information I was missing. Oleg On Wed, Dec 23, 2015 at 10:55 AM, George Neuner wrote: > Hi Oleg, > > On Wed, 23 Dec 2015 07:07:31 -0600, oleg yusim > wrote: > > >May we run into situation, when attacker dumps memor

Re: [GENERAL] Shared system resources

2015-12-23 Thread oleg yusim
postgres server processes have access to this shared memory segment" It helped me to understand terminology used by other reponders better. Thanks, Oleg On Wed, Dec 23, 2015 at 10:48 AM, John R Pierce wrote: > On 12/23/2015 8:16 AM, oleg yusim wrote: > >> >> To my kn

Re: [GENERAL] Shared system resources

2015-12-23 Thread oleg yusim
ch get's used by database processes, but doesn't belong to database permanent storage? Can you give me more details here, so I would understand the actual mapping and scale of the issue? Thanks, Oleg On Wed, Dec 23, 2015 at 9:55 AM, Jim Nasby wrote: > On 12/23/15 7:55 AM, oleg

Re: [GENERAL] Shared system resources

2015-12-23 Thread oleg yusim
uring the session into memory, reserved by session process? I'm trying to determine, basically, does it even worth a talk - maybe there is nothing at all valuable. Thanks, Oleg On Wed, Dec 23, 2015 at 7:41 AM, David Wilson wrote: > On Wed, Dec 23, 2015 at 07:07:31AM -0600, oleg yusim wro

Re: [GENERAL] Shared system resources

2015-12-23 Thread oleg yusim
kernel have any safeguard against it? Thanks, Oleg On Wed, Dec 23, 2015 at 2:13 AM, George Neuner wrote: > On Tue, 22 Dec 2015 23:21:27 +, David Wilson > wrote: > > >On Linux the memory pages of an exiting process aren't sanitized at > >exit, however it is impo

Re: [GENERAL] Shared system resources

2015-12-22 Thread oleg yusim
but I would like to find out if this gates are opened too or not. Thanks, Oleg On Tue, Dec 22, 2015 at 8:48 PM, Jim Nasby wrote: > On 12/22/15 6:03 PM, oleg yusim wrote: > >> Absolutely. But we are not talking about that type of data leakage here. >> We are talking about potent

Re: [GENERAL] Shared system resources

2015-12-22 Thread oleg yusim
emory (memory would be a common resource here). Thanks, Oleg On Tue, Dec 22, 2015 at 5:28 PM, John R Pierce wrote: > On 12/22/2015 2:52 PM, oleg yusim wrote: > > > *The DBMS must prevent unauthorized and unintended information transfer > via shared system resources.* > > &g

[GENERAL] Shared system resources

2015-12-22 Thread oleg yusim
that, my question would be: When user disconnects, process is terminated and all resources are released, does memory, session/process stored information at gets "sanitized" or just released as is? Thanks, Oleg

Re: [GENERAL] Session Identifiers

2015-12-22 Thread oleg yusim
Thanks Michael, you are right, that is a very good alternative solution. Oleg On Tue, Dec 22, 2015 at 6:27 AM, Michael Paquier wrote: > On Tue, Dec 22, 2015 at 1:42 AM, Stephen Frost wrote: > > Oleg, > > > > * oleg yusim (olegyu...@gmail.com) wrote: > >

Re: [GENERAL] Session Identifiers

2015-12-21 Thread oleg yusim
, coupled with usage of pg_stat_activity and cron (it also has code too): http://stackoverflow.com/questions/12391174/how-to-close-idle-connections-in-postgresql-automatically Thanks everybody, Oleg On Mon, Dec 21, 2015 at 10:51 AM, Melvin Davidson wrote: > Pursuant to Stehen's suggesti

Re: [GENERAL] Session Identifiers

2015-12-21 Thread oleg yusim
se if network connection is broken and session left hanging. For psql prompt case looks like pg_terminate_backend() would be the only solution. Thanks, Oleg On Sun, Dec 20, 2015 at 11:33 AM, Melvin Davidson wrote: > Actually, I'm not an expert on the tcp_keepalives, but I

Re: [GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
Hi Andrew, Exactly! Vulnerability is the direct analogy of one with Unix shell. The way we generally deal with Unix shell vulnerability, we configure the shell to terminate on its own if timeout was exceeded. The question here is, can we configure psql client to behave the same? Thanks, Oleg

Re: [GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
So Pavel, are are saying there is no such thing as Session ID in PostgreSQL DB at all? Everything is tight to the process, session is accociated with, so in essence pid is session id? Oleg On Sun, Dec 20, 2015 at 11:40 AM, Pavel Stehule wrote: > > > 2015-12-20 18:37 GMT+01:00 o

Re: [GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
Thanks Melvin, Let me experiment with it for a bit. I will let you know results. Oleg On Sun, Dec 20, 2015 at 11:33 AM, Melvin Davidson wrote: > Actually, I'm not an expert on the tcp_keepalives, but I believe the > tcp_keepalives_count > should be 1, otherwise it will t

Re: [GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
case, here we would be dealing with Session IDs belonging to DB itself, not OpenSSL. Please, correct me if I'm wrong. Thanks, Oleg On Sun, Dec 20, 2015 at 11:28 AM, Tom Lane wrote: > oleg yusim writes: > > Got it, thanks... Now, is it any protection in place currently against

Re: [GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
Thanks you very much Melvin, once again, very useful. So, let me see if I got it right, following configuration should cause my database connection to terminate in 15 minutes, right? tcp_keepalives_idle = 900 tcp_keepalives_interval=1 tcp_keepalives_count=3 Oleg On Sun, Dec 20, 2015 at 11:14 AM

Re: [GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
)? Oleg On Sun, Dec 20, 2015 at 11:02 AM, Pavel Stehule wrote: > > > 2015-12-20 17:52 GMT+01:00 oleg yusim : > >> Hi Pavel, >> >> Thanks, for your response, it helps. Now, from my observations >> (PostgreSQL 9.4.5, installed on Linux box), if I enter psql prompt

Re: [GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
Hi Melvin, Thank you very much, that logging option really helps (I need to give instructions, people, who are not very code literate should be capable of executing). And, point taken about exact version and enviornment - PostgreSQL 9.4.5, Linux box. Thanks, Oleg On Sun, Dec 20, 2015 at 10:19

Re: [GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
imeout (or rather doesn't have one), or I just happened to miss configuration option? Thanks, Oleg On Sun, Dec 20, 2015 at 10:08 AM, Pavel Stehule wrote: > Hi > > 2015-12-20 16:16 GMT+01:00 oleg yusim : > >> Greetings! >> >> I'm new to PostgreSQL, working

[GENERAL] Session Identifiers

2015-12-20 Thread oleg yusim
t counts too). Does PostgreSQL perform this type of actions? If so, where are those Session IDs are stored, so I can verify it? Thanks, Oleg

Re: [GENERAL] json indexing and data types

2015-12-12 Thread Oleg Bartunov
On Wed, Dec 2, 2015 at 11:48 AM, Kaare Rasmussen wrote: > Hi > > As json essentially only has three basic data types, string, int, and > boolean, I wonder how much of this - to index, search, and sort on > unstructured data - is possible. I guess part of the answer would be > 'jsquery and vodka'

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
mentioned), PostgreSQL integrates nicely with? Oleg On Thu, Dec 10, 2015 at 4:45 PM, Adrian Klaver wrote: > On 12/10/2015 02:13 PM, oleg yusim wrote: > >> Adrian, >> >> You seemed to be familiar with the STIG world, so how about V-ID from >> > > No, I am just f

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
Thanks Tom, I get what you are saying and that seems to be final at this stage. I will write pg_audit down, though. Oleg On Thu, Dec 10, 2015 at 4:41 PM, Tom Lane wrote: > oleg yusim writes: > > What I hope to achieve is to meet this requirement from Database SRG: > &g

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
Federal security requirements and such can be used in multiple products other DBs can't (for that very reason). Thanks, Oleg On Thu, Dec 10, 2015 at 4:52 PM, John R Pierce wrote: > On 12/10/2015 2:03 PM, Adrian Klaver wrote: > >> >> So some aspect of this: >> >&

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
rship information. Internal checks, which are going on all the time do not count. Thanks, Oleg On Thu, Dec 10, 2015 at 4:03 PM, Adrian Klaver wrote: > On 12/10/2015 01:36 PM, oleg yusim wrote: > >> Adrian, >> >> What I hope to achieve is to meet this requirement from Database

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
same time, I do not want to get 20 GB of logs on the daily basis, by setting log_statement = 'all'. So, I'm trying to find a way in between. Thanks, Oleg On Thu, Dec 10, 2015 at 3:29 PM, Adrian Klaver wrote: > On 12/10/2015 12:56 PM, oleg yusim wrote: > >> So w

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
gres superuser What seems to be open questions to me with this model: 1) Way to check what log_statement set to on per user basis (what table should I query?) 2) Way to ensure that only superuser can run meta commands, such as \du, \dp, \z Thanks, Oleg On Thu, Dec 10, 2015 at 2:50 P

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
Hi David, Can you, please, give me example? Thanks, Oleg On Thu, Dec 10, 2015 at 2:25 PM, David G. Johnston < david.g.johns...@gmail.com> wrote: > On Thu, Dec 10, 2015 at 1:20 PM, oleg yusim wrote: > >> Also... how do we control who can run meta commands? >> > &

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
Hmm... let me see if I got it right. I can set log_statement to mod overall, and then modify it as ALTER USER postgres SET log_statement=all; for postgres only? Also... how do we control who can run meta commands? Thanks, Oleg On Thu, Dec 10, 2015 at 2:16 PM, Jerry Sievers wrote: > Scott M

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
Thanks John, I realized that and confirmed in my logs. What I'm trying to determine now, can I only log some SELECT statements, or I should log all of them or none of them. Oleg On Thu, Dec 10, 2015 at 1:40 PM, John R Pierce wrote: > On 12/10/2015 9:58 AM, oleg yusim wrote: > &g

Re: [GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
ng is because with 'all" volume of daily logging becomes truly ginormous. And for my purposes, I really do not need all the SELECT statements to be logged. Only those, which are responsible for explicit querying of role/privileges/roles (so, \du, \dp, \z, in essence). Thanks, Oleg On Thu,

[GENERAL] Loggingt psql meta-commands

2015-12-10 Thread oleg yusim
Greetings! I'm new to PostgreSQL, working on it from the point of view of Cyber Security assessment. In regards to the here is my question: Is it a way to enable logging for psql prompt meta-commands, such as \du, \dp, \z, etc? Thanks, Oleg

Re: [GENERAL] JSON path wild cards?

2015-11-24 Thread Oleg Bartunov
ut you may try our jsquery extension https://github.com/postgrespro/jsquery. Oleg > > -- > Sent via pgsql-general mailing list (pgsql-general@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-general >

Re: [GENERAL] How to speed up pg_trgm / gin index scan

2015-06-22 Thread Oleg Bartunov
Try 9.4 and you'll surprise. 1. GIN has compression 2. GIN has fast scan feature. Oleg On Mon, Jun 22, 2015 at 7:51 AM, Christian Ramseyer wrote: > Hi > > I have a pretty large table with syslog messages. > > It is already partitioned by month, and for a single month I hav

[GENERAL] Is there any way to measure disk activity for each query?

2015-06-18 Thread Oleg Serov
Hello! I'm wondering, if there any way to measure how much disk-io were generated by a query? -- Best Regards, Oleg

Re: [GENERAL] [to_tsvector] German Compound Words

2015-05-28 Thread Oleg Bartunov
ts_debug() ? =# select * from ts_debug('english', 'messages'); alias | description | token | dictionaries | dictionary | lexemes ---+-+--++--+-- asciiword | Word, all ASCII | messages | {english_stem} | english_st

Re: [GENERAL] [tsvector] to_tsvector called multiple times

2015-05-26 Thread Oleg Bartunov
You can ask http://snowball.tartarus.org/ for stemmer. Meanwhile, you can have small personal dictionary (before stemmer) with such exceptions, for example, use synonym template system system Oleg On Tue, May 26, 2015 at 11:18 AM, Sven R. Kunze wrote: > Hi everybody, > > the

Re: [GENERAL] Grouping By Similarity (using pg_trgm)?

2015-05-22 Thread Oleg Bartunov
Have you seen http://www.sai.msu.su/~megera/postgres/talks/pgcon-2012.pdf ? On Thu, May 14, 2015 at 9:58 PM, Cory Tucker wrote: > [pg version 9.3 or 9.4] > > Suppose I have a simple table: > > create table data ( > my_value TEXT NOT NULL > ); > CREATE INDEX idx_my_value ON data USING gin(my_v

Re: [GENERAL] Find similar records (compare tsvectors)

2015-03-06 Thread Oleg Bartunov
On Fri, Mar 6, 2015 at 5:05 PM, Patrick Dung wrote: > Resend. > > How to quickly compare the similarity of two tsvector? > check http://www.sai.msu.su/~megera/postgres/talks/pgcon-2012.pdf > > On Monday, March 2, 2015 11:01 PM, Patrick Dung > wrote: > > > Hello, > > I had a database with artic

Re: [GENERAL] WAL supported extension

2015-01-18 Thread Oleg Bartunov
On Sun, Jan 18, 2015 at 2:01 PM, Michael Paquier wrote: > Oleg Bartunov wrote: > > We are eager for development of this API. > Yeah, me too actually :) Oleg, are there plans on your side to do > something in this area for 9.6? > Yes, Alexander Korotkov will continue workin

  1   2   3   4   5   6   >