Re: [HACKERS] literature on write-ahead logging

2011-06-10 Thread Jim Nasby
On Jun 9, 2011, at 9:28 AM, Robert Haas wrote: > On Thu, Jun 9, 2011 at 10:22 AM, Alvaro Herrera > wrote: >>> 1. Subdivide XLOG insertion into three operations: (1) allocate space >>> in the log buffer, (2) copy the log records into the allocated space, >>> and (3) release the space to the buffer

Re: [HACKERS] literature on write-ahead logging

2011-06-09 Thread Robert Haas
On Thu, Jun 9, 2011 at 12:52 PM, Tom Lane wrote: > Robert Haas writes: >> [ lots of interesting stuff about WAL optimization snipped ] > >> ... Second, they aren't really using locks, unless you count >> bus locks - they appear to have implemented most or all of it via >> CAS-based lock-free algo

Re: [HACKERS] literature on write-ahead logging

2011-06-09 Thread Tom Lane
Robert Haas writes: > [ lots of interesting stuff about WAL optimization snipped ] > ... Second, they aren't really using locks, unless you count > bus locks - they appear to have implemented most or all of it via > CAS-based lock-free algorithms, which is probably well-justified > optimization e

Re: [HACKERS] literature on write-ahead logging

2011-06-09 Thread Robert Haas
On Thu, Jun 9, 2011 at 11:13 AM, Alvaro Herrera wrote: > Excerpts from Robert Haas's message of jue jun 09 10:55:45 -0400 2011: >> On Thu, Jun 9, 2011 at 10:34 AM, Alvaro Herrera >> wrote: > >> > Slower than sleeping?  Consider that this doesn't need to be done for >> > each record insertion, onl

Re: [HACKERS] literature on write-ahead logging

2011-06-09 Thread Alvaro Herrera
Excerpts from Robert Haas's message of jue jun 09 10:55:45 -0400 2011: > On Thu, Jun 9, 2011 at 10:34 AM, Alvaro Herrera > wrote: > > Slower than sleeping?  Consider that this doesn't need to be done for > > each record insertion, only when you need to flush (maybe more than > > that, but I think

Re: [HACKERS] literature on write-ahead logging

2011-06-09 Thread Robert Haas
On Thu, Jun 9, 2011 at 10:34 AM, Alvaro Herrera wrote: > Excerpts from Robert Haas's message of jue jun 09 10:28:39 -0400 2011: >> On Thu, Jun 9, 2011 at 10:22 AM, Alvaro Herrera >> wrote: >> >> 1. Subdivide XLOG insertion into three operations: (1) allocate space >> >> in the log buffer, (2) cop

Re: [HACKERS] literature on write-ahead logging

2011-06-09 Thread Alvaro Herrera
Excerpts from Robert Haas's message of jue jun 09 10:28:39 -0400 2011: > On Thu, Jun 9, 2011 at 10:22 AM, Alvaro Herrera > wrote: > >> 1. Subdivide XLOG insertion into three operations: (1) allocate space > >> in the log buffer, (2) copy the log records into the allocated space, > >> and (3) relea

Re: [HACKERS] literature on write-ahead logging

2011-06-09 Thread Robert Haas
On Thu, Jun 9, 2011 at 10:22 AM, Alvaro Herrera wrote: >> 1. Subdivide XLOG insertion into three operations: (1) allocate space >> in the log buffer, (2) copy the log records into the allocated space, >> and (3) release the space to the buffer manager for eventual write to >> disk.  AIUI, WALInser

Re: [HACKERS] literature on write-ahead logging

2011-06-09 Thread Alvaro Herrera
Excerpts from Robert Haas's message of mié jun 08 23:24:34 -0400 2011: > I did a brief literature search for papers on breaking the > WAL-serialization bottleneck today and hit upon this: > > Aether: A Scalable Approach to Logging, Ryan Johnson, Ippokratis Pandis, et > al. > http://infoscience.ep

Re: [HACKERS] literature on write-ahead logging

2011-06-08 Thread Merlin Moncure
On Wed, Jun 8, 2011 at 11:24 PM, Robert Haas wrote: > I did a brief literature search for papers on breaking the > WAL-serialization bottleneck today and hit upon this: > > Aether: A Scalable Approach to Logging, Ryan Johnson, Ippokratis Pandis, et > al. > http://infoscience.epfl.ch/record/149436