Re: [Discuss/Vote] upgrade to Yarn 2.6.0

Thanks, Yi! On Wed, Aug 19, 2015 at 1:58 PM, Yi Pan wrote: > Hi, Roger, > > In LinkedIn we have already moved to YARN 2.6 and is moving to YARN 2.7 > now. I am not aware of any major issues in upgrading. I will let our team > member Jon Bringhurst to chime in since he did all the upgrade and may

Re: [Discuss/Vote] upgrade to Yarn 2.6.0

Hi, Roger, In LinkedIn we have already moved to YARN 2.6 and is moving to YARN 2.7 now. I am not aware of any major issues in upgrading. I will let our team member Jon Bringhurst to chime in since he did all the upgrade and may have more insights. @Jon, could you help to comment on this? Thanks!

[DISCUSS] Sliding window implementation in Samza

Hi, 1. I came across Windowing functionality in Samza. It looks like it implements a static window. Is there a sliding window functionality available in Samza? 2. How to do aggregation across multi-node yarn node, any pointers to it? E.g : Lets say I have 2 slave machines wher

Re: [DISCUSS] KIP-28 - Add a transform client for data processing

Hello Yan, Thanks for the feedback, replies inlined. Guozhang On Wed, Aug 19, 2015 at 8:22 AM, Yan Fang wrote: > Hi Guozhang, > > Thank you for writing the KIP-28 up. (Hope this is the right thread for me > to post some comments. :) > > I still have some confusing about the implementation of t

Re: [Discuss/Vote] upgrade to Yarn 2.6.0

We're using 2.4.0 in production. Are there any major incompatibilities to watch out for when upgrading to 2.6.0? Thanks, Roger On Mon, Aug 17, 2015 at 4:41 PM, Yan Fang wrote: > Hi guys, > > we have been discussing upgrading to Yarn 2.6.0 (SAMZA-536 >

[DISCUSS] KIP-28 - Add a transform client for data processing

Hi Guozhang, Thank you for writing the KIP-28 up. (Hope this is the right thread for me to post some comments. :) I still have some confusing about the implementation of the Processor: 1. why do we maintain a separate consumer and producer for each worker thread? — from my understanding, t

Re: Review Request 37528: SAMZA-736 BrokerProxy will stuck in infinite loop if consumer.fetch throws OOME

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37528/ --- (Updated Aug. 19, 2015, 9:03 a.m.) Review request for samza. Changes ---

Review Request 37604: SAMZA-760 Samza Container should catch Throwables instead of just catching Exceptions

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37604/ --- Review request for samza. Repository: samza Description --- Added a catc