RE: Kafka topic retention

Hi Tony, the "log.retention.hours" property is only for topic retention period, this does not affect the topic's deletion. Your data is correctly deleted but, the only way to remove a topic is to use "./bin/kafka-topics.sh --zookeeper localhost:2181 --delete --topic testTopic" After that you

Kafka topic retention

Hi, I'm working with KAFKA_2.11-1.0.0. I'm using the following configuration in server.properties for LOG RETENTION POLICY: * log.retention.hours=168 * log.segment.bytes=1073741824 * log.retention.check.interval.ms=30 I'm trying to delete the kafka topic "testTopi

Re: advertised.listeners

@Darshan, For PLAINTEXT channels, principal will be "ANONYMOUS". You need to give produce/consume permissions to "User:ANONYMOUS" On Wed, Apr 4, 2018 at 8:10 AM, Joe Hammerman < jhammer...@squarespace.com.invalid> wrote: > Hi all, > > Is it possible to run mixed mode with PLAINTEXT and SSL with

Re: Error with kafka stream and kafka

What broker and Streams version do you use? Can you share the log/error message/stacktrace? -Matthias On 4/3/18 10:58 AM, Ariel Debernardi wrote: > Hi, > > I have a services with kafka with three brokers, and other with kafka > streams. > > In kafka we have a topic "dep-stream", whit 12 partiti

Re: advertised.listeners

Hi all, Is it possible to run mixed mode with PLAINTEXT and SSL with no SASL? What should port and advertised listeners values in kafka-server.properties be set in order to configure such an access profile? We want to so in order to be able to perform healthchecking on the loopback device without

Re: advertised.listeners

(from MessageBroker consumer) >tracert MessageProducer if zk server is found in tracert then yes you have a MB quorom FWIR Mixing PLAINTEXT with SASL-SSL on ZK is not supported https://stackoverflow.com/questions/46912937/is-it-possible-to-connect-zookeeper-and-kafka-via-sasl-kafka-broker-and-

Re: advertised.listeners

We are using 0.10.2.1 and ZK 3.4.9. Can something be derived from this piece of info ? Thanks. On Tue, Apr 3, 2018 at 3:13 PM, Martin Gainty wrote: > tracert MessageBrokerIP > > do you see ZK server in the trace? > > if yes then you are running kafka-cluster > > (ZK does not support mixed mode b

Re: advertised.listeners

tracert MessageBrokerIP do you see ZK server in the trace? if yes then you are running kafka-cluster (ZK does not support mixed mode but there is a backdoor zookeeper.properties config attribute that allows plaintext clients to bypass sasl auth) ? Martin __

Re: Running SSL and PLAINTEXT mode together (Kafka 10.2.1)

Hi Jaikiran My producer is getting *WARN Error while fetching metadata with correlation id 1 : {Topic4006=TOPIC_AUTHORIZATION_FAILED} (org.apache.kafka.clients.NetworkClient)* error. To test it out my producer is the default Kafka console client which I am trying to use like this: *bin/kafka-cons

Re: advertised.listeners

Hi Rajini The above configuration that you mentioned a while back helped me sort the issue of listeners and I was also able to run Kafka 0.10.2.1 with SSL and ACLs as well from one of your other posts. I wanted to ask you if it is possible to run Kafka in a mixed security mode? i.e. external prod

Error with kafka stream and kafka

Hi, I have a services with kafka with three brokers, and other with kafka streams. In kafka we have a topic "dep-stream", whit 12 partitions and 3 replication-factor. In Kafka Stream, we consume data from topics and when a broker in Kafka is down, we have this error: Connection to node 2 could no

Re: Closing a KafkaConsumer triggers a rebalance in KafkaConsumers subscribed to other topics. Is this the expected behavior?

I believe you have answered your own question. Having the system enforce which topics each consumer in a consumer group needs to consume messages from may be restricting, and possibly expensive. I have seen this brought up a few times and discussed it with a colleague. I am not clear as to what

Closing a KafkaConsumer triggers a rebalance in KafkaConsumers subscribed to other topics. Is this the expected behavior?

Kafka brokers version: 0.11.0.0 Kafka client version: 0.11.0.2 If we have two KafkaConsumer using the same group.id (running in the same process or in two different processes) and one of them is closed, it triggers a rebalance in the other KafkaConsumer even if they were subscribed to different to

Re: Tips for debugging per partition stream time?

Matthias, Thanks again for the detailed explanation. My customer doesn't want this information, but I do. They want simple aggregations (Tell me how many events happened on this stream between time 0-30, 30-60, 60-90, etc). Sometimes the aggregations don't fire at the time I would expect. This

Re: accessing Kafka broker 0.9.0.1 with Kafka-client 1.0.0

You definitively cannot use 1.0.0 to access a 0.9.0.1 broker. Amongst many other changes, I can think of the new OUTSIDE listener and breaking changes in the protocol... Salu2, Quique. 2018-04-03 15:36 GMT+02:00 Nomar Morado : > Hi, > > I am trying to access my Kafka brokers using springbok 2.0

accessing Kafka broker 0.9.0.1 with Kafka-client 1.0.0

Hi, I am trying to access my Kafka brokers using springbok 2.0 which is using Kafka-client 1.0.0 and it seems like running into timeout exceptions waiting for metadata update. Not sure if we can use 1.0.0 client for my 0.9.0.1 broker - anyone has thoughts on this? Thanks.

Re: Making a Window services for kafka having sasl and ssl configuration

From: ashish chauhan Sent: Tuesday, April 3, 2018 4:16 AM To: users@kafka.apache.org Subject: Making a Window services for kafka having sasl and ssl configuration I am trying to make Window services for kafka having sasl and ssl configuration to keep it always

Making a Window services for kafka having sasl and ssl configuration

I am trying to make Window services for kafka having sasl and ssl configuration to keep it always running when my machine starts. I am not sure how to set the following at run time for ssl authentication ,configuring and setting the jvm parameter before making the window services. set KAFKA_OPTS=