Re: Kafka Authorization and ACLs Broken

2017-05-25 Thread Mike Marzo
Stupid question If u don't specify a jaas file how does the consumer and producer specify the Id that acl's are configured against boy I am getting more and more perplexed by this... mike marzo 908 209-4484 On May 24, 2017 9:29 PM, "Raghav" wrote: > Mike >

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Mike Marzo
Thanks. We will try it. Struggling with krb5 and acls mike marzo 908 209-4484 On May 24, 2017 9:29 PM, "Raghav" wrote: > Mike > > I am not using jaas file. I literally took the config Rajini gave in the > previous email and it worked for me. I am using ssl Kafka with

Re: Kafka Authorization and ACLs Broken

2017-05-24 Thread Mike Marzo
I'm also having issues getting acls to work. Out of intereat, are you starting ur brokers with a jaas file, if so do u mind sharing the client and server side jaas entries so I can validate what I'm doing. mike marzo 908 209-4484 On May 24, 2017 10:54 AM, "Raghav" wrote: &

Re: Kafka and zookeeper stores and mesos env

2016-12-08 Thread Mike Marzo
hu, Dec 8, 2016 at 2:33 PM Mike Marzo > wrote: > > If i'm running a 5 node zk cluster and a 3 node kafka cluster in dcker on a > mesos/marathon environment where my zk and broker nodes are all leveraging > local disk on the hosts they are running on is there any value to the

Kafka and zookeeper stores and mesos env

2016-12-08 Thread Mike Marzo
If i'm running a 5 node zk cluster and a 3 node kafka cluster in dcker on a mesos/marathon environment where my zk and broker nodes are all leveraging local disk on the hosts they are running on is there any value to the local data being preserved across restarts? In other words when a broker

Re: High level consumer with separate zk

2014-09-10 Thread Mike Marzo
But that could potentially impact the brokers directly. Which is my core concern. Is there any idea of the perf impact of having brokers be client aware. This moves kafka more toward the traditional mom style messaging broker... mike marzo 908 209-4484 On Sep 10, 2014 11:24 AM, "Jonathan

High level consumer with separate zk

2014-09-10 Thread Mike Marzo
Is it possible for the high level consumer to use a different zk cluster than the cluster that manages broker leader electivity? The high level consumer adds a lot of value but I don't like the idea that bad user code could pound the core zk and effectively hurt the kafka brokers mike marz

Re: Kafka Mock

2014-04-30 Thread Mike Marzo
I will have a look. Thanks mike marzo 908 209-4484 On Apr 30, 2014 4:56 PM, "Olson,Andrew" wrote: > You might take a look at the KafkaServerTestHarness [1] if you’re not > already familiar with it. It’s not exactly “mock”, but it makes it easy to > test Kafka functionality

Re: Kafka Mock

2014-04-29 Thread Mike Marzo
a socket server which someone can talk to following the > kafka server protocol or you need other funtionalities of the server? > > Guozhang > > > On Tue, Apr 29, 2014 at 10:41 AM, Mike Marzo > wrote: > > > Is there any good mock impls of kafka that can be leveraged in junit > tests? > > > > > > -- > -- Guozhang >

Kafka Mock

2014-04-29 Thread Mike Marzo
Is there any good mock impls of kafka that can be leveraged in junit tests?

Re: Kafka contrib/hadoop-consumer not working with hadoop 2.2.0

2014-03-26 Thread Mike Marzo
I wrote my own hdfs writer using threaded simple kafka consumer writing to hdfs using java FSDataOutputStream works perfect mike marzo 908 209-4484 On Mar 26, 2014 12:59 PM, "Marcelo Valle" wrote: > Kafka native hadoop-consumer is compiled with hadoop 0.20 dependencies, so &g