Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-08-01 Thread Jean-Baptiste Onofré
Hi Pei, thanks for the update. I'm starting to plan with your branch, comparing/overwriting my own one. I will keep you posted. Regards JB On 08/01/2017 02:01 PM, Pei HE wrote: I prototyped a simple MapReduce runner that can executes Read.Bounded+ParDo+Combine: https://github.com/peihe/incu

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-08-01 Thread Pei HE
I prototyped a simple MapReduce runner that can executes Read.Bounded+ParDo+Combine: https://github.com/peihe/incubator-beam/tree/mr-runner I am still working on View support, and will give another update once I can get WordCount runs. On Sat, Jul 15, 2017 at 4:45 AM, Vikas RK wrote: > Thanks P

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-14 Thread Vikas RK
Thanks Pei, left a few comments, but this looks exciting! -Vikas On 12 July 2017 at 21:52, Jean-Baptiste Onofré wrote: > Hi, > > I will push my branch with the current state of the mapreduce runner. > > Regards > JB > > > On 07/13/2017 04:47 AM, Pei HE wrote: > >> Thanks guys! >> >> I replied K

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-12 Thread Jean-Baptiste Onofré
Hi, I will push my branch with the current state of the mapreduce runner. Regards JB On 07/13/2017 04:47 AM, Pei HE wrote: Thanks guys! I replied Kenn's comments, and looking forward to more feedbacks and suggestions. Also, could we add a mapreduce-runner branch? Thanks -- Pei On Sat, Jul

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-12 Thread Pei HE
Thanks guys! I replied Kenn's comments, and looking forward to more feedbacks and suggestions. Also, could we add a mapreduce-runner branch? Thanks -- Pei On Sat, Jul 8, 2017 at 12:42 AM, Kenneth Knowles wrote: > Very cool to see this. Commenting a little on the doc. > > On Fri, Jul 7, 2017

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-07 Thread Kenneth Knowles
Very cool to see this. Commenting a little on the doc. On Fri, Jul 7, 2017 at 8:41 AM, Jean-Baptiste Onofré wrote: > Hi Pei, > > I also pumped some ideas and part of code from Crunch for the MapReduce > runner. > > I will push my changes on my github branch and share with you. > > Let me take a

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-07 Thread Jean-Baptiste Onofré
Hi Pei, I also pumped some ideas and part of code from Crunch for the MapReduce runner. I will push my changes on my github branch and share with you. Let me take a look on your doc. Regards JB On 07/07/2017 03:11 PM, Pei HE wrote: Hi all, While JB is working on MapReduce Runner BEAM-165

Re: [DISCUSS] Beam MapReduce Runner One-Pager

2017-07-07 Thread Jesse Anderson
Basing this on Crunch's approach is a good way to go. I'd really love to see this happen. On Fri, Jul 7, 2017 at 6:11 AM Pei HE wrote: > Hi all, > While JB is working on MapReduce Runner BEAM-165 > , I have spent time > reading > Apache Crunch code

[DISCUSS] Beam MapReduce Runner One-Pager

2017-07-07 Thread Pei HE
Hi all, While JB is working on MapReduce Runner BEAM-165 , I have spent time reading Apache Crunch code and drafted Beam MapReduce Runner One-Pager