Re: Samza -- A YARN stream processing framework for Kafka

2013-08-27 Thread Xavier Stevens
I can't answer the rest but the catchy name is from Gregor Samza. A character from Kafka's novel called The Metamorphosis. https://en.wikipedia.org/wiki/Gregor_Samsa#Gregor_Samsa -Xavier On Tue, Aug 27, 2013 at 6:51 AM, Jonathan Hodges wrote: > First off, I want to say this is awesome! It h

Re: Samza -- A YARN stream processing framework for Kafka

2013-08-27 Thread Jonathan Hodges
First off, I want to say this is awesome! It has been great to see all the great YARN offerings being released lately. I noticed Hadoop 2.x was recently voted beta so very exciting! Like many we use Storm for near real-time processing our Kafka based streams. In addition we send this data to Ha

Samza -- A YARN stream processing framework for Kafka

2013-08-23 Thread Jay Kreps
Hey guys, This may be relevant to people on this list. A few of us at LinkedIn have been working on Samza, a stream processing framework built on YARN. We just added this as an Apache Incubator project. We would love to get people's feedback (and help!). Here are the docs: http://samza.incubator.