Samza metric consumers

I am wondering if there are any off-the-shelf systems for consuming Samza metrics, whether. It be consuming them from a topic or by polling JXM. What are folks using that is not all custom made?

Re: Executing Samza jobs natively in Kubernetes

On Mon, Dec 14, 2015 at 11:55 AM, Jagadish Venkatraman < jagadish1...@gmail.com> wrote: > > Thanks for the great work! This is super-helpful. Another cool feature is > that this implementation pushes alot of failure handling/restarting to the > cluster manager. > > I've some questions on the imple

Re: Executing Samza jobs natively in Kubernetes

licit container > additions and removals. For e.g. if a new container is explicitly added or > removed via a config change, the system would change the partition to > container mapping (and persist it durably back in the coordinator stream). > > Thanks > Kartik > > > > On Mo

Re: Executing Samza jobs natively in Kubernetes

BTW, I reviewed the StandaloneJob proposal in SAMZA-516 thinking it could have been useful in running Samza in Kubernetes and I was disappointed to find out it was not the case. StandaloneJob goes a step beyond the most basic job implementation as it attempts to handle failures through rebalances m

Re: Executing Samza jobs natively in Kubernetes

On Mon, Nov 30, 2015 at 12:31 PM, Jakob Homan wrote: > This is awesome work. Thanks. Feel like a hack, but it got the job done. > Would be interested in opening JIRAs for the > changes you need so we can start to process them? > I've opened: - SAMZA-824

Re: Executing Samza jobs natively in Kubernetes

dynamic > task management. Thanks for sharing this. It may be a good interim > solution. > > Roger > > On Sun, Nov 29, 2015 at 11:18 AM, Elias Levy > wrote: > > > I've been exploring Samza for stream processing as well as Kubernetes as > a > > container orchest

Executing Samza jobs natively in Kubernetes

I've been exploring Samza for stream processing as well as Kubernetes as a container orchestration system and I wanted to be able to use one with the other. The prospect of having to execute YARN either along side or on top of Kubernetes did not appeal to me, so I developed a KubernetesJob impleme

JRuby port of Hello Samza

I am exploring Samza for some of our use cases. As we have a lot of Ruby developers, I decided to determine if we could use JRuby with Samza. After some work, I've been able to write Ruby jobs. To demonstrate the details, I've ported the Hello Samza project to JRuby. You can find the port at htt