Re: failed to delete kafka topic when building from source

Any followup on if there is some problems in deleting topics in new version of Kafka (kafka_2.10-0.10.2.0-SNAPSHOT). I have also noticed some testcases failed around these lines: org.apache.kafka.streams.integration.JoinIntegrationTest > testInnerKStreamKTable FAILED org.apache.kafka.common.e

Kafka SSL encryption plus external CA

Hi, I have read the docs extensively but yet there are a few answers I can’t find. It has to do with external CA Please confirm my understanding if possible: I can create my own CA to sign all the brokers and clients certificates. Pros: - cheap, easy, automated. I need to find a way to access tha

Re: Timeout publishing message to Kafka cluster.

if any of you have any idea about this issue, please let me know. I still confused some points : 1), why restart the node `1002` can automatically solve the `replication issue` ? 2), is there any possible this issue caused by the `log retention` setting? i.e `log.segment.bytes=136870912` , is it

Re: Timeout publishing message to Kafka cluster.

​Post the configuration here for help: [root@2494f8e6fb37 config]# vi server.properties # Licensed to the Apache Software Foundation (ASF) under one or more # contributor license agreements. See the NOTICE file distributed with # this work for additional information regarding copyright ownership.

Re: Timeout publishing message to Kafka cluster.

when that error happened, I need to manually restart the kafka node `1002`, after restart finishing, all of the partition is being healthy again. i.e *before start ​:* 3 *1002* *(1002,1004,1005)* *(1

Timeout publishing message to Kafka cluster.

Hi, Recently, we ran into the `batch expired` error in several days, may be 3 or 5 days, there is not fixed frequency. *A,* the error is: Exception Class : org.apache.kafka.common.errors.TimeoutException Error Message : Batch Expired *B*: server.log from kafka : [2016-12-18 20:45:32,371] INFO

Halting because log truncation is not allowed for topic __consumer_offsets

Would be grateful to hear opinions from experts out there. Thanks in advance > On Dec 17, 2016, at 11:06 AM, Jun MA wrote: > > Hi, > > We saw the following FATAL error in 2 of our brokers (3 in total, the active > controller doesn’t have this) and they crashed in the same time. > > [2016-12-

Re: need some help in understanding weird IllegalStateException: Log end offset should not change while restoring

IIRC, his is a know and already fixed bug. AFAIK, the fix will be part of Kafka 0.10.1.1 -- the vote for the release is already running, so it should be available soon. -Matthias On 12/17/16 11:32 PM, Sachin Mittal wrote: > Hi, > What I have noticed recently is that when running the streams a

Re: Is running kafka streaming application advisable on high latency WAN setup

Streams is designed to run in same DC as brokers. So you might want to move the app, or replicate the topics you are interested in into the second DC (using mirror maker of Confluent's proprietary replication tool). Nevertheless, if you increase timeouts etc. you might still be able to make it wor

Re: Running cluster of stream processing application

> 1. Do we need to call system exit in UncaughtExceptionHandler. There is no *need* for it. It really depends what you *want* to do. System.exit is quite a hard termination of your application. Usually, if your Streams part of you application dies, you still want to clean up the other parts of you

Re: log.flush.interval.messages setting of Kafka 0.9.0.0

Would be grateful to hear opinions from experts out there. Thanks in advance > 在 2016年12月16日，下午6:17，Json Tu 写道： > > Hi all, > we have a cluster of 0.9.0.0 with 3 nodes, we have a topic with 3 > replicas, and send it with ack -1, our sending latency is avg 7ms. I prepare > to optimize pe

Re: effect of high IOWait on KStream app?

Could this delay be contributing to the various issues Im seeing? - extended / repeating rebalances - broker connection drops On Sat, Dec 17, 2016 at 10:27 AM, Eno Thereska wrote: > Yeah, the numbers for the streams tests seem to be low. For reference, > here is what I get when I run it on my

Re: checking consumer lag on KStreams app?

The group should be whatever you used for StreamsConfig.APPLICATION_ID_CONFIG. Using this value Im able to see offsets using 'kafka-consumer-groups --new-consumer --bootstrap-server --group --describe' On Sat, Dec 17, 2016 at 10:48 PM, Sachin Mittal wrote: > Hi, > Looks like the kafka-consume