Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-09-01 Thread Steve Loughran
On 25 Aug 2017, at 20:22, Aaron Fabbri mailto:fab...@cloudera.com>> wrote: Thank you everyone for reviewing and voting on the S3Guard feature branch merge. It looks like the Vote was a success. We have six binding +1's (Steve Loughran, Sean Mackrory, Mingliang Liu, Sanjay Radia, Kihwal Lee, an

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-25 Thread Aaron Fabbri
Thank you everyone for reviewing and voting on the S3Guard feature branch merge. It looks like the Vote was a success. We have six binding +1's (Steve Loughran, Sean Mackrory, Mingliang Liu, Sanjay Radia, Kihwal Lee, and Lei (Eddy) Xu) and zero -1's. I will coordinate w/ Steve L to get this commi

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-24 Thread Mingliang Liu
Thanks Andrew. Arpit also told me about this but I forgot to bring it up here. Best, > On Aug 24, 2017, at 10:59 AM, Andrew Wang wrote: > > FYI that committer +1s are binding on merges, so Sean and Mingliang's +1s > can be upgraded to binding. > > On Thu, Aug 24, 2017 at 6:09 AM, Kihwal Lee w

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-24 Thread Andrew Wang
FYI that committer +1s are binding on merges, so Sean and Mingliang's +1s can be upgraded to binding. On Thu, Aug 24, 2017 at 6:09 AM, Kihwal Lee wrote: > +1 (binding) > Great work guys! > > On Thu, Aug 24, 2017 at 5:01 AM, Steve Loughran > wrote: > > > > > On 23 Aug 2017, at 19:21, Aaron Fabbr

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-24 Thread Kihwal Lee
+1 (binding) Great work guys! On Thu, Aug 24, 2017 at 5:01 AM, Steve Loughran wrote: > > On 23 Aug 2017, at 19:21, Aaron Fabbri mailto:fa > b...@cloudera.com>> wrote: > > > On Tue, Aug 22, 2017 at 10:24 AM, Steve Loughran mailto:ste...@hortonworks.com>> wrote: > video being processed: https://

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-24 Thread Steve Loughran
On 23 Aug 2017, at 19:21, Aaron Fabbri mailto:fab...@cloudera.com>> wrote: On Tue, Aug 22, 2017 at 10:24 AM, Steve Loughran mailto:ste...@hortonworks.com>> wrote: video being processed: https://www.youtube.com/watch?v=oIe5Zl2YsLE&feature=youtu.be Awesome demo Steve, thanks for doing this.

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-23 Thread sanjay Radia
+1 (binding) Thanks community for all the hard that went into this critical piece of work. sanjay > > > On 22 Aug 2017, at 11:17, Steve Loughran > mailto:ste...@hortonworks.com>> wrote: > > +1 (binding) > > I'm happy with it; it's a great piece of work by (in no particular order): > Chris

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-23 Thread Aaron Fabbri
On Tue, Aug 22, 2017 at 10:24 AM, Steve Loughran wrote: > video being processed: https://www.youtube.com/watch? > v=oIe5Zl2YsLE&feature=youtu.be > > Awesome demo Steve, thanks for doing this. Particularly glad to see folks using and extending the failure injection client. Demoing the CLI tool

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-22 Thread Sean Mackrory
+1 (non-binding) On Tue, Aug 22, 2017 at 10:24 AM, Steve Loughran wrote: > video being processed: https://www.youtube.com/watch? > v=oIe5Zl2YsLE&feature=youtu.be > > its actually quite hard to show any benefits of s3guard on the command > line, so I've ended up showing some scala tests where I

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-22 Thread Steve Loughran
video being processed: https://www.youtube.com/watch?v=oIe5Zl2YsLE&feature=youtu.be its actually quite hard to show any benefits of s3guard on the command line, so I've ended up showing some scala tests where I turn on the (bundled) inconsistent AWS client to show how you then need to enable s

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-22 Thread Steve Loughran
+1 (binding) I'm happy with it; it's a great piece of work by (in no particular order): Chris Nauroth, Aaron Fabbri, Sean McRory & Mingliang Liu. plus a few bits in the corners where I got to break things while they were all asleep. Also deserving a mention: Thomas Demoor & Ewan Higgs @ WDC for

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-21 Thread Lei Xu
+1 (binding) S3guard significantly extends the use cases of Hadoop with S3. I was involved in the early days of the development. Really appreciate the high quality work and collaborative environment from the Hadoop community. Best, On Mon, Aug 21, 2017 at 1:09 PM, Aaron Fabbri wrote: > + Eddy

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-21 Thread Aaron Fabbri
+ Eddy Xu (having list issues) On Mon, Aug 21, 2017 at 8:10 AM, Steve Loughran wrote: > > On 18 Aug 2017, at 17:51, John Zhuge ohn.zh...@gmail.com>> wrote: > > That will be great. Please record it if possible. > > good idea. I'll do a video & demo, that way I can avoid fielding hard > questio

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-21 Thread Steve Loughran
On 18 Aug 2017, at 17:51, John Zhuge mailto:john.zh...@gmail.com>> wrote: That will be great. Please record it if possible. good idea. I'll do a video & demo, that way I can avoid fielding hard questions On Fri, Aug 18, 2017 at 4:12 AM, Steve Loughran mailto:ste...@hortonworks.com>> wrote:

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-19 Thread Mingliang Liu
+1 (non-binding) I also worked on this project from start to finish and I really enjoyed the collaboration in community. The feature is to solve the very important and challenging consistency problem as stated in the design doc. All patches were reviewed by feature/trunk committers and we have

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-18 Thread John Zhuge
That will be great. Please record it if possible. On Fri, Aug 18, 2017 at 4:12 AM, Steve Loughran wrote: > > I can do a demo of this next week if people are interested > > > On 17 Aug 2017, at 23:07, Aaron Fabbri wrote: > > > > Hello, > > > > I'd like to open a vote (7 days, ending August 24 at

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-18 Thread Steve Loughran
I can do a demo of this next week if people are interested > On 17 Aug 2017, at 23:07, Aaron Fabbri wrote: > > Hello, > > I'd like to open a vote (7 days, ending August 24 at 3:10 PST) to merge the > HADOOP-13345 feature branch into trunk. > > This branch contains the new S3Guard feature whic

[VOTE] Merge HADOOP-13345 (S3Guard feature branch)

2017-08-17 Thread Aaron Fabbri
Hello, I'd like to open a vote (7 days, ending August 24 at 3:10 PST) to merge the HADOOP-13345 feature branch into trunk. This branch contains the new S3Guard feature which adds metadata consistency features to the S3A client. Formatted site documentation can be found here: https://github.com/