Re: Python Kafka Client API to support kerberozed secure Kafka cluster?

2017-04-21 Thread Yuxiang Mai
Thanks, Matt.We will try it. On Fri, Apr 14, 2017 at 11:38 PM, Matt Howlett wrote: > confluent-kafka-python is built on librdkafka which can do kerberos > security. > > https://github.com/confluentinc/confluent-kafka-python > > some notes on how to configure it are here: > > https://github.com/e

Calculating time elapsed using event start / stop notification messages

2017-04-21 Thread Ali Akhtar
I have a tricky use case where a user initiates an event (by clicking a button) and then stops it (by clicking it again, losing connection, closing the browser, etc). Each time the event starts or stops, a notification is sent to a kafka topic, with the user's id as the message key and the current

[VOTE] 0.10.2.1 RC3

2017-04-21 Thread Gwen Shapira
Hello Kafka users, developers, friends, romans, countrypersons, This is the fourth (!) candidate for release of Apache Kafka 0.10.2.1. It is a bug fix release, so we have lots of bug fixes, some super important. Release notes for the 0.10.2.1 release: http://home.apache.org/~gwenshap/kafka-0.10.

Re: Calculating time elapsed using event start / stop notification messages

2017-04-21 Thread Eno Thereska
Hi Ali, One starting point would be the low level Processor API, where you get each event and process it. You can also use a persistent state store to keep track of the events seen so far, it can probably be an in-memory store. An an entry can probably be deleted once both start and stop events

more than 1 active controler

2017-04-21 Thread wei
We noticed we have more than 2 active controllers. How can we fix the issue? it has been for a few days. Thanks, Wei

Re: more than 1 active controler

2017-04-21 Thread Jeff Widman
Remove the /controller znode in zookeeper and it will force kafka to trigger a new controller re-election. On Fri, Apr 21, 2017 at 1:58 PM, wei wrote: > We noticed we have more than 2 active controllers. How can we fix the > issue? it has been for a few days. > > Thanks, > Wei >

Re: more than 1 active controler

2017-04-21 Thread Mayuresh Gharat
Hi Wei, Do you mean to say...you had 2 controllers in your kafka cluster for a few days and everything was fine? Did you investigate how the cluster got in to that state? Thanks, Mayuresh On Fri, Apr 21, 2017 at 2:04 PM, Jeff Widman wrote: > Remove the /controller znode in zookeeper and it wi

Recording - Storm & Kafka Meetup on April 20th 2017

2017-04-21 Thread Roshan Naik
It was a great meetup and for the benefit of those interested but unable to attend it, here is a link to the recording : https://www.youtube.com/watch?v=kCRv6iEd7Ow List of Talks: - Introduction – Suresh Srinivas (Hortonworks) - [4m:31sec] – Overview of Storm 1.1 - Hugo

Re: Recording - Storm & Kafka Meetup on April 20th 2017

2017-04-21 Thread Andrew Psaltis
Fantastic!! Thanks for sharing, wish I could have been there. On Fri, Apr 21, 2017 at 21:08 Roshan Naik wrote: > It was a great meetup and for the benefit of those interested but unable > to attend it, here is a link to the recording : > > https://www.youtube.com/watch?v=kCRv6iEd7Ow > > List of T

Re: Recording - Storm & Kafka Meetup on April 20th 2017

2017-04-21 Thread Naresh Kosgi
Thank you for posting On Fri, Apr 21, 2017 at 9:08 PM, Roshan Naik wrote: > It was a great meetup and for the benefit of those interested but unable > to attend it, here is a link to the recording : > > > > https://www.youtube.com/watch?v=kCRv6iEd7Ow > > > > List of Talks: > > - *Introd