Re: [HACKERS] Early locking option to parallel backup

2017-11-08 Thread Lucas B
On 11/06/2017 12:30 PM, Stephen Frost wrote: * Lucas (luca...@gmail.com) wrote: pg_dump was taking more than 24 hours to complete in one of my databases. I begin to research alternatives. Parallel backup reduced the backup time to little less than a hour, but it failed almost every time because

Re: [HACKERS] Early locking option to parallel backup

2017-11-06 Thread Lucas B
Em 05/11/2017 21:09, Andres Freund escreveu: On 2017-11-05 17:38:39 -0500, Robert Haas wrote: On Sun, Nov 5, 2017 at 5:17 AM, Lucas wrote: The patch creates a "--lock-early" option which will make pg_dump to issue shared locks on all tables on the backup TOC on each parallel wo

Re: [HACKERS] Preventing deadlock on parallel backup

2016-09-08 Thread Lucas
Tom, Yes, it is what I mean. Is what pg_dump uses to get things synchronized. It seems to me a clear marker that the same task is using more than one connection to accomplish the one job. Em 08/09/2016 6:34 PM, "Tom Lane" escreveu: > Lucas writes: > > The queue jumping lo

Re: [HACKERS] Preventing deadlock on parallel backup

2016-09-08 Thread Lucas
shared lock that is already granted to another connection in the same distributed transaction it should be granted right away... make sense? Em 08/09/2016 4:15 PM, "Tom Lane" escreveu: > Lucas writes: > > I made a small modification in pg_dump to prevent parallel backup &g

[HACKERS] Preventing deadlock on parallel backup

2016-09-08 Thread Lucas
People, I made a small modification in pg_dump to prevent parallel backup failures due to exclusive lock requests made by other tasks. The modification I made take shared locks for each parallel backup worker at the very beginning of the job. That way, any other job that attempts to acquire exclu

Re: [HACKERS] Buffer Requests Trace

2014-10-16 Thread Lucas Lersch
, I think that the execution time of the benchmark is irrelevant, assuming that the transactions follow a normal distribution regarding accesses to warehouses. On Wed, Oct 15, 2014 at 7:41 PM, Jeff Janes wrote: > On Wed, Oct 15, 2014 at 6:22 AM, Lucas Lersch > wrote: > >> So i

Re: [HACKERS] Buffer Requests Trace

2014-10-15 Thread Lucas Lersch
: > * Lucas Lersch (lucasler...@gmail.com) wrote: > > So is it a possible normal behavior that running tpcc for 10min only > access > > 50% of the database? Furthermore, is there a guideline of parameters for > > tpcc (# of warehouses, execution time, operations weight)? > >

Re: [HACKERS] Buffer Requests Trace

2014-10-15 Thread Lucas Lersch
So is it a possible normal behavior that running tpcc for 10min only access 50% of the database? Furthermore, is there a guideline of parameters for tpcc (# of warehouses, execution time, operations weight)? On Wed, Oct 15, 2014 at 3:09 PM, Simon Riggs wrote: > On 15 October 2014 13:44, Lu

Re: [HACKERS] Buffer Requests Trace

2014-10-15 Thread Lucas Lersch
I am recording the BufferDesc.tag.blockNum for the buffer along with the spcNode, dbNode, relNode, also present in the tag. On Wed, Oct 15, 2014 at 2:27 PM, Simon Riggs wrote: > On 15 October 2014 12:49, Lucas Lersch wrote: > > Sorry for taking so long to answer. I am sending att

Re: [HACKERS] Buffer Requests Trace

2014-10-15 Thread Lucas Lersch
, Simon Riggs wrote: > On 14 October 2014 17:08, Lucas Lersch wrote: > > > Unfortunately, in the generated trace with over 2 million buffer > requests, > > only ~14k different pages are being accessed, out of the 800k of the > whole > > database. Am I missing something h

Re: [HACKERS] Buffer Requests Trace

2014-10-14 Thread Lucas Lersch
; into the shared_buffers. On Tue, Oct 14, 2014 at 7:21 PM, Stephen Frost wrote: > * Lucas Lersch (lucasler...@gmail.com) wrote: > > Aren't heap and index requests supposed to go through the shared buffers > > anyway? > > Sure they do, but a given page in shared_buffers c

Re: [HACKERS] Buffer Requests Trace

2014-10-14 Thread Lucas Lersch
Aren't heap and index requests supposed to go through the shared buffers anyway? On Tue, Oct 14, 2014 at 7:02 PM, Stephen Frost wrote: > * Lucas Lersch (lucasler...@gmail.com) wrote: > > shared_buffers is 128MB and the version of pgsql is 9.3.5 > > I suspect you're no

Re: [HACKERS] Buffer Requests Trace

2014-10-14 Thread Lucas Lersch
shared_buffers is 128MB and the version of pgsql is 9.3.5 On Tue, Oct 14, 2014 at 6:31 PM, Lucas Lersch wrote: > Sorry, I do not understand the question. > > But I forgot to give an additional information: I am printing the page id > for the trace file in ReleaseBuffer() only if it

Re: [HACKERS] Buffer Requests Trace

2014-10-14 Thread Lucas Lersch
, Oct 14, 2014 at 6:25 PM, Stephen Frost wrote: > * Lucas Lersch (lucasler...@gmail.com) wrote: > > Unfortunately, in the generated trace with over 2 million buffer > requests, > > only ~14k different pages are being accessed, out of the 800k of the > whole > > database.

[HACKERS] Buffer Requests Trace

2014-10-14 Thread Lucas Lersch
something here? Best regards. -- Lucas Lersch

[HACKERS] Postgre inner work question

2011-04-11 Thread Lucas Cotta
Hi! Does postgre execute the queries following a execution plan tree, where the leafs are table scans, and the nodes are joins? I'm looking for a database where I can get a cardinality from a partial result of the execution... for example, print the cardinality of the results until the next join

[HACKERS] Postgre inner work question

2011-04-11 Thread Lucas Cotta
Hi! Does postgre execute the queries following a execution plan tree, where the leafs are table scans, and the nodes are joins? I'm looking for a database where I can get a cardinality from a partial result of the execution... for example, print the cardinality of the results until the next join

Re: [HACKERS] scheduler in core

2010-02-21 Thread Lucas
s, cleanups and periodic consistency checks and diagnostics without external dependencies. I wonder if the scheduler already existed before the implementation of the autovacuum, its implementation would not be a function executed by the in-core scheduler? - - Lucas -- Sent via pgsql-hacke

Re: [HACKERS] scheduler in core

2010-02-20 Thread Lucas
there isn't anything an > in-core implementation could do that an external one doesn't do as well > or better. So I'm not eager to take on additional maintenance burden > for such a thing. > >regards, tom lane > > -- > Sent via pgsql-hackers mailing list (pgsql-hackers@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-hackers > -- Lucas

Re: [HACKERS] SELECT ... FOR UPDATE [WAIT integer | NOWAIT] for 8.5

2009-05-11 Thread Lucas Brito
uration parameters to be set only in the duration of the transaction or the next "n" commands? -- Lucas Brito