Re: Review Request 37026: SAMZA-727: Support for Kerberos

2016-05-07 Thread Chen Song
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37026/ --- (Updated May 8, 2016, 12:50 a.m.) Review request for samza. Changes ---

Re: Review Request 37026: SAMZA-727: Support for Kerberos

2016-05-07 Thread Chen Song
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37026/ --- (Updated May 7, 2016, 10:38 p.m.) Review request for samza. Changes ---

Re: Review Request 37026: SAMZA-727: Support for Kerberos

2016-05-07 Thread Chen Song
> On April 27, 2016, 9:16 p.m., Yi Pan (Data Infrastructure) wrote: > > samza-yarn/src/main/scala/org/apache/samza/job/yarn/ClientHelper.scala, > > line 271 > > > > > > Shouldn't the second be YarnConfig.YARN_KEBERO

Re: samza job start takes 20 minutes to figure out the Checkpointed offset

2016-05-07 Thread Jagadish Venkatraman
Hi, Is your checkpoint topic log compacted? That may help in reducing the size of the log. On Sat, May 7, 2016 at 2:35 AM, Liu Bo wrote: > Hi group > > I've got this problem while doing maintenance of our samza job, that job > has been running for a while and processed nearly 350 million data,

samza job start takes 20 minutes to figure out the Checkpointed offset

2016-05-07 Thread Liu Bo
Hi group I've got this problem while doing maintenance of our samza job, that job has been running for a while and processed nearly 350 million data, we have 40 partitions with 10s checkpoint commit interval, this leads to a checkpoint topic with 18308702 messages. 10s interval is probably too sh