UNSUBSCIBE ME

2017-04-10 Thread Zac Harvey
UNSUBSCRIBE ME (BTW this doesn't work)

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Hi how do I unsubscribe from this mailist list, the details in the docs are not the correct set of steps. From: Zac Harvey Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misleading/broken/outdated I am

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Hi, how do I unsubscribe from this mailing list. From: Zac Harvey Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misleading/broken/outdated I am trying to unsubscribe to this mailing list. When I go to

Re: Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
Any ideas? From: Zac Harvey Sent: Thursday, March 23, 2017 10:03:48 AM To: users@kafka.apache.org Subject: Mailing list docs are misleading/broken/outdated I am trying to unsubscribe to this mailing list. When I go to: https://kafka.apache.org/contact Apache

Mailing list docs are misleading/broken/outdated

2017-03-23 Thread Zac Harvey
I am trying to unsubscribe to this mailing list. When I go to: https://kafka.apache.org/contact Apache Kafka kafka.apache.org Contact Mailing Lists. We have a few mailing lists hosted by Apache: users@kafka.apache.org: A list for general user questions about K

Console producer can connect locally but not locally

2017-01-25 Thread Zac Harvey
I have a single Kafka node at, say, IP address 1.2.3.4. If I SSH into that node from 2 different terminal windows, and run the console consumer from 1 terminal, and the console producer from another terminal, everything works great: # Run the consumer from terminal 1 kafka-console-consumer.s

Re: Kafka Streams: how can I get the name of the Processor when calling `KStream.process`

2017-01-18 Thread Zac Harvey
Sorry that last response was for a different thread - please ignore (and sorry!) From: Michael Noll Sent: Wednesday, January 18, 2017 9:56:35 AM To: users@kafka.apache.org Subject: Re: Kafka Streams: how can I get the name of the Processor when calling `KStream.p

Re: Correlation Id errors for both console producer and consumer

2017-01-18 Thread Zac Harvey
Anybody ever seen this before? Anybody have any ideas as to where I can start troubleshooting? From: Zac Harvey Sent: Tuesday, January 17, 2017 4:40:35 PM To: users@kafka.apache.org Subject: Re: Correlation Id errors for both console producer and consumer Hi

Re: Kafka Streams: how can I get the name of the Processor when calling `KStream.process`

2017-01-18 Thread Zac Harvey
Anybody ever seen this before? Anybody have any ideas as to where I can start troubleshooting? From: Michael Noll Sent: Wednesday, January 18, 2017 9:56:35 AM To: users@kafka.apache.org Subject: Re: Kafka Streams: how can I get the name of the Processor when cal

Re: Correlation Id errors for both console producer and consumer

2017-01-17 Thread Zac Harvey
console producer and consumer What versions of Kafka and Zookeeper are you using? On Tue, Jan 17, 2017 at 11:57 AM, Zac Harvey wrote: > I have 2 Kafkas backed by 3 ZK nodes. I want to test the Kafka nodes by > running the kafka-console-producer and -consumer locally on each node. > &

Correlation Id errors for both console producer and consumer

2017-01-17 Thread Zac Harvey
I have 2 Kafkas backed by 3 ZK nodes. I want to test the Kafka nodes by running the kafka-console-producer and -consumer locally on each node. So I SSH into one of my Kafka brokers using 2 different terminals. In terminal #1 I run the consumer like so: /opt/kafka/bin/kafka-console-consumer.

Re: Writing a customized principal builder for authorization

2016-11-30 Thread Zac Harvey
How do you then modify Kafka's searchable classpath to pick up this new principal.builder.class classfile from a JAR somewhere on the filesystem? In other words, I change my server.properties to: principal.builder.class=com.example.kafkautils.MyCustomKafkaPrincipalBuilder How will Kafka be a

Re: Messages intermittently get lost

2016-11-30 Thread Zac Harvey
eeper feeds Thanks Martin __ ____________ From: Zac Harvey Sent: Tuesday, November 29, 2016 10:46 AM To: users@kafka.apache.org Subject: Re: Messages intermittently get lost Does anybody have any idea why ZK might be to blame if mess

Re: Messages intermittently get lost

2016-11-29 Thread Zac Harvey
Does anybody have any idea why ZK might be to blame if messages sent by a Kafka producer fail to be received by a Kafka consumer? From: Zac Harvey Sent: Monday, November 28, 2016 9:07:41 AM To: users@kafka.apache.org Subject: Re: Messages intermittently get lost

Re: Messages intermittently get lost

2016-11-28 Thread Zac Harvey
, November 25, 2016 1:46:28 PM To: users@kafka.apache.org Subject: Re: Messages intermittently get lost From: Zac Harvey Sent: Friday, November 25, 2016 6:17 AM To: users@kafka.apache.org Subject: Re: Messages intermittently get lost Hi Martin, My

Re: Messages intermittently get lost

2016-11-25 Thread Zac Harvey
covery.threads.per.data.dir= ? Martin __ ________ From: Zac Harvey Sent: Thursday, November 24, 2016 7:05 AM To: users@kafka.apache.org Subject: Re: Messages intermittently get lost Anybody?!? This is very disconcerting! ________ From:

Re: Messages intermittently get lost

2016-11-24 Thread Zac Harvey
Anybody?!? This is very disconcerting! From: Zac Harvey Sent: Wednesday, November 23, 2016 5:07:45 AM To: users@kafka.apache.org Subject: Messages intermittently get lost I am playing around with Kafka and have a simple setup: * 1-node Kafka (Ubuntu) server

Messages intermittently get lost

2016-11-23 Thread Zac Harvey
I am playing around with Kafka and have a simple setup: * 1-node Kafka (Ubuntu) server * 3-node ZK cluster (each on their own Ubuntu server) I have a consumer written in Scala and am using the kafka-console-producer (v0.10) that ships with the distribution. I'd say about 20% of the messages

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
disable Rule #1 and change Rule #2 to use port 9093, you should be able to test PLAINTEXT without changing Kafka config. On Mon, Nov 21, 2016 at 3:32 PM, Zac Harvey wrote: > In the last email I should have mentioned: don't pay too much attention to > the code snippet, and after reviewin

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
n) indicate bad configs on the Kafka broker? ____ From: Zac Harvey Sent: Thursday, November 17, 2016 4:44:06 PM To: users@kafka.apache.org Subject: Can Kafka/SSL be terminated at a load balancer? We have two Kafka nodes and for reasons outside of this question, would li

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
uce/consume messages. If we put a LB in front > of all brokers which means all brokers share the same LB how does the LB > figure out the leader? > On Mon, Nov 21, 2016 at 10:26 PM Martin Gainty > wrote: > > > > > > > > > > >

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
the load balancer and the load balancer uses PLAINTEXT without authentication to talk to Kafka. On Mon, Nov 21, 2016 at 1:29 PM, Zac Harvey wrote: > *Awesome* explanation Rajini - thank you! > > > Just to confirm: the SASL/PLAIN configs would only be for the interbroker > communi

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-21 Thread Zac Harvey
g like: KafkaServer { org.apache.kafka.common.security.plain.PlainLoginModule required username="kafka" user_kafka="kafka-password" password="kafka-password"; }; Hope that helps. On Fri, Nov 18, 2016 at 6:39 PM, Zac Harvey wrote: > Thanks again Rajini! > > > O

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-18 Thread Zac Harvey
cer and consumer that are shipped with Kafka to make sure it is working before you run with Ruby clients. On Fri, Nov 18, 2016 at 1:23 PM, Zac Harvey wrote: > > Thanks Rajini, > > > So currently one of our Kafka nodes is 'mykafka01.example.com', and in > its server.prop

Re: Can Kafka/SSL be terminated at a load balancer?

2016-11-18 Thread Zac Harvey
configure Kafka brokers with the proxy host as the host in the advertised listeners for the security protocol used by clients. On Thu, Nov 17, 2016 at 9:44 PM, Zac Harvey wrote: > We have two Kafka nodes and for reasons outside of this question, would > like to set up a load balancer to

Can Kafka/SSL be terminated at a load balancer?

2016-11-17 Thread Zac Harvey
We have two Kafka nodes and for reasons outside of this question, would like to set up a load balancer to terminate SSL with producers (clients). The SSL cert hosted by the load balancer will be signed by trusted/root CA that clients should natively trust. Is this possible to do, or does Kafka