Re: Samza / Kafka Streams Future

2016-05-23 Thread Kartik Paramasivam
KStreams was surely incubated based on early Samza learnings. Although they have a common base in terms of architecture, they started evolving independently a year ago. In the last year there have been significant improvements in Samza in order to make stateful stream processing more reliable an

Re: Review Request 46282: SAMZA-928 document Kerberos on YARN

2016-05-23 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/46282/#review134509 --- Thanks for answering all the questions. There is one more point I

Re: Review Request 37026: SAMZA-727: Support for Kerberos

2016-05-23 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/37026/#review134501 --- Fix it, then Ship it! Hi, Chen, thanks for the update! One more

Re: Review Request 46282: SAMZA-928 document Kerberos on YARN

2016-05-23 Thread Chen Song
> On April 26, 2016, 7:33 p.m., Yi Pan (Data Infrastructure) wrote: > > docs/learn/documentation/versioned/yarn/yarn-security.md, line 28 > > > > > > nit: remove *config*, we can directly refer to the coordinator stre

Re: Review Request 37026: SAMZA-727: Support for Kerberos

2016-05-23 Thread Chen Song
> On April 27, 2016, 9:16 p.m., Yi Pan (Data Infrastructure) wrote: > > samza-yarn/src/main/java/org/apache/samza/config/YarnConfig.java, line 131 > > > > > > This configuration is missing in the doc patch. Will upd

Re: Review Request 47620: SAMZA-951 - Improve event loop timing metrics

2016-05-23 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47620/#review134473 --- Ship it! Ship It! - Yi Pan (Data Infrastructure) On May 23,

Re: Java 8, RocksDB and Samza 0.10.0

2016-05-23 Thread Yi Pan
Hi, Louis, If you just write up a paragraph of description, I am happy to add that to FAQ page. Thanks! -Yi On Mon, May 23, 2016 at 10:36 AM, Louis Calisi wrote: > I would be happy to. I assume you mean this page? > > https://cwiki.apache.org/confluence/display/SAMZA/FAQ > > I don’t have perm

Re: Review Request 47620: SAMZA-951 - Improve event loop timing metrics

2016-05-23 Thread Jake Maes
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47620/ --- (Updated May 23, 2016, 9:03 p.m.) Review request for samza, Boris Shkolnik, Chr

Re: Review Request 47620: SAMZA-951 - Improve event loop timing metrics

2016-05-23 Thread Jake Maes
> On May 23, 2016, 6:31 p.m., Yi Pan (Data Infrastructure) wrote: > > samza-core/src/main/scala/org/apache/samza/container/SamzaContainerMetrics.scala, > > line 45 > > > > > > This may result in some "alerts" from ex

Re: Review Request 47687: Merged patch 44920

2016-05-23 Thread Jagadish Venkatraman
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47687/ --- (Updated May 23, 2016, 6:34 p.m.) Review request for samza, Yi Pan (Data Infras

Re: Review Request 47620: SAMZA-951 - Improve event loop timing metrics

2016-05-23 Thread Yi Pan (Data Infrastructure)
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/47620/#review134411 --- Code lgtm. One high-level comment: we should run some perf test to

Re: Samza / Kafka Streams Future

2016-05-23 Thread Radoslaw Gruchalski
Sriram, I had exactly the same questions recently. From what I see, Kafka Streams does not provide a way for consuming just one partition? Or, at least, it is not an easy find in the documentation. This seems to be the major difference between Samza and KStream. I might be spreading FUD so plea

Re: Java 8, RocksDB and Samza 0.10.0

2016-05-23 Thread Louis Calisi
I would be happy to. I assume you mean this page? https://cwiki.apache.org/confluence/display/SAMZA/FAQ I don’t have permission to edit it. Louis On 5/23/16, 1:17 PM, "Yi Pan" wrote: >Awesome! @Louis, do you mind to contribute a section to FAQ for this issue? >That would help all users wh

Samza / Kafka Streams Future

2016-05-23 Thread Sriram Ramachandrasekaran
Hello Yi, et all, I've been following Samza and Kafka (and, Kafka Streams). Given the state where Kafka Streams is, it provides a nice high level API for consuming stuff from Kafka + support for localized state. If thrown into an environment like mesos(fronted by marathon), we should get distribut

Re: Java 8, RocksDB and Samza 0.10.0

2016-05-23 Thread Yi Pan
Awesome! @Louis, do you mind to contribute a section to FAQ for this issue? That would help all users who encounter this issue later. Thanks! -Yi On Fri, May 20, 2016 at 10:09 AM, Louis Calisi wrote: > We finally found the issue. The two links in my original email lead me to > believe it was w

Re: Review Request 46282: SAMZA-928 document Kerberos on YARN

2016-05-23 Thread Chen Song
> On April 26, 2016, 7:33 p.m., Yi Pan (Data Infrastructure) wrote: > > docs/learn/documentation/versioned/yarn/yarn-security.md, line 48 > > > > > > nit: trailing white space done. > On April 26, 2016, 7:33 p.m.,