SSL setup in Kafka 2.10.0.10.2.1 for keystore and truststore files

2017-09-28 Thread Awadhesh Gupta
Hello, I am trying to setup Kafka SSL using certificates on my windows machine using reference of security_overview section of Kafka documents. I have created server.keystore.jks, client.keystore.jks and respective trust store file and signed it using keytool command. I followed complete steps as

Re: SSL setup in Kafka 2.10.0.10.2.1 for keystore and truststore files

2017-09-28 Thread M. Manna
Hi Awadhesh, This seems like your certificate import order (intermediate - root) is jumbled up. Could you kindly follow the instructions on confluent.io where Ismael Juma has provided a nice set of steps to follow for SSL setup. https://www.confluent.io/blog/apache-kafka-security-authorization-au

Re: windowed store excessive memory consumption

2017-09-28 Thread Stas Chizhov
Sure. Here we go: https://issues.apache.org/jira/browse/KAFKA-5985 2017-09-28 0:23 GMT+02:00 Matthias J. Sax : > >> I have a feeling that it would be helpful to add this to documentation > >> examples as well as javadocs for all methods that do return iterators. > > That makes sense. Can you cre

Kafka consumer issue

2017-09-28 Thread Sthitaprajna
I am getting weird ArrayIndexOutOfBoundsException while reading kafka topics. Spent lot of time but couldn't figure-out the issue. Can anyone help/suggest anything on this. Here is my log. [2017-09-28 01:53:04,341][][][INFO][qtp1961176822-1087][o.a.k.c.c.i.ConsumerCoordinator]Setting newly assig

Re: To Know about Kafka and it's usage

2017-09-28 Thread David Garcia
If you’re on the AWS bandwagon, you can use Kinesis-Analytics (https://aws.amazon.com/kinesis/analytics/). It’s very easy to use. Kafka is a bit more flexible, but you have to instrument maintain it. You may also want to look at Druid: http://druid.io/ There are some dashboards that you can

Re: To Know about Kafka and it's usage

2017-09-28 Thread Ted Yu
Parth : bq. an application which could take some real time data Can you be a bit more specific on what your goal is ? It would help narrow down the choices you have. Cheers On Thu, Sep 28, 2017 at 8:01 AM, David Garcia wrote: > If you’re on the AWS bandwagon, you can use Kinesis-Analytics ( >

Re: windowed store excessive memory consumption

2017-09-28 Thread Matthias J. Sax
Thanks! On 9/28/17 2:19 AM, Stas Chizhov wrote: > Sure. Here we go: https://issues.apache.org/jira/browse/KAFKA-5985 > > 2017-09-28 0:23 GMT+02:00 Matthias J. Sax : > I have a feeling that it would be helpful to add this to documentation examples as well as javadocs for all methods th

dumping JMX data

2017-09-28 Thread Brian Dugdale
You can do the following on the kafka server itself after setting up jmxremote for port -Dcom.sun.management.jmxremote -Dcom.sun.management.jmxremote.authenticate=false -Dcom.sun.management.jmxremote.ssl=false -Dcom.sun.management.jmxremote.port= kafka-run-class.sh kafka.tools.JmxToo