Re: Wait for parallel workers to attach

2018-02-02 Thread Peter Geoghegan
On Fri, Feb 2, 2018 at 6:11 AM, Robert Haas wrote: >> Fair enough, you can proceed with the patch. > > Committed. Now, on to the main event! Thank you both. -- Peter Geoghegan

Re: Wait for parallel workers to attach

2018-02-02 Thread Robert Haas
On Thu, Feb 1, 2018 at 9:48 PM, Amit Kapila wrote: > On Thu, Feb 1, 2018 at 9:09 PM, Robert Haas wrote: >> On Wed, Jan 31, 2018 at 10:08 PM, Amit Kapila >> wrote: >>> I think suggesting to use this API to wait "for a specific worker" >>> doesn't seem like a good idea as it doesn't have any such

Re: Wait for parallel workers to attach

2018-02-01 Thread Amit Kapila
On Thu, Feb 1, 2018 at 9:09 PM, Robert Haas wrote: > On Wed, Jan 31, 2018 at 10:08 PM, Amit Kapila wrote: >> I think suggesting to use this API to wait "for a specific worker" >> doesn't seem like a good idea as it doesn't have any such provision. > > I see your point, but in the absence of a mor

Re: Wait for parallel workers to attach

2018-02-01 Thread Robert Haas
On Wed, Jan 31, 2018 at 10:08 PM, Amit Kapila wrote: > I think suggesting to use this API to wait "for a specific worker" > doesn't seem like a good idea as it doesn't have any such provision. I see your point, but in the absence of a more specific API it could be used that way, and it wouldn't b

Re: Wait for parallel workers to attach

2018-01-31 Thread Amit Kapila
On Wed, Jan 31, 2018 at 9:53 PM, Robert Haas wrote: > On Wed, Jan 31, 2018 at 3:57 AM, Amit Kapila wrote: >>> * There might be some opportunity to share some of the new code with >>> the code recently committed to WaitForParallelWorkersToFinish(). For >>> one thing, the logic in this block could

Re: Wait for parallel workers to attach

2018-01-31 Thread Robert Haas
On Wed, Jan 31, 2018 at 3:57 AM, Amit Kapila wrote: >> * There might be some opportunity to share some of the new code with >> the code recently committed to WaitForParallelWorkersToFinish(). For >> one thing, the logic in this block could be refactored into a >> dedicated function that is called

Re: Wait for parallel workers to attach

2018-01-31 Thread Amit Kapila
On Mon, Jan 29, 2018 at 4:01 AM, Peter Geoghegan wrote: > On Sat, Jan 27, 2018 at 12:14 AM, Amit Kapila wrote: > > I also found that all of these errors were propagated. The patch helps > parallel CREATE INDEX as expected/designed. > Great! > Some small things that I noticed about the patch: >

Re: Wait for parallel workers to attach

2018-01-30 Thread Amit Kapila
On Wed, Jan 31, 2018 at 8:46 AM, Robert Haas wrote: > On Tue, Jan 30, 2018 at 10:10 PM, Amit Kapila wrote: >> I am not getting what exactly you are suggesting here. The wait loop >> is intended for the case when some workers are not started. We want >> to wait for sometime before checking again

Re: Wait for parallel workers to attach

2018-01-30 Thread Robert Haas
On Tue, Jan 30, 2018 at 10:10 PM, Amit Kapila wrote: >> known_started_workers looks a lot like any_message_received. Perhaps >> any_message_received should be renamed to known_started_workers and >> reused here. > > Sure, that sounds good to me. Do you prefer a separate patch for > renaming any_

Re: Wait for parallel workers to attach

2018-01-30 Thread Amit Kapila
On Mon, Jan 29, 2018 at 8:25 PM, Robert Haas wrote: > On Sat, Jan 27, 2018 at 3:14 AM, Amit Kapila wrote: >> During the recent development of parallel operation (parallel create >> index)[1], a need has been arised for $SUBJECT. The idea is to allow >> leader backend to rely on number of workers

Re: Wait for parallel workers to attach

2018-01-29 Thread Robert Haas
On Sat, Jan 27, 2018 at 3:14 AM, Amit Kapila wrote: > During the recent development of parallel operation (parallel create > index)[1], a need has been arised for $SUBJECT. The idea is to allow > leader backend to rely on number of workers that are successfully > started. This API allows leader

Re: Wait for parallel workers to attach

2018-01-28 Thread Peter Geoghegan
On Sat, Jan 27, 2018 at 12:14 AM, Amit Kapila wrote: > During the recent development of parallel operation (parallel create > index)[1], a need has been arised for $SUBJECT. The idea is to allow > leader backend to rely on number of workers that are successfully > started. This API allows leader

Wait for parallel workers to attach

2018-01-27 Thread Amit Kapila
During the recent development of parallel operation (parallel create index)[1], a need has been arised for $SUBJECT. The idea is to allow leader backend to rely on number of workers that are successfully started. This API allows leader to wait for all the workers to start or fail even if one of t