kafka-2.0.0-src/bin/kafka-topics.sh The shell file is empty;

2018-10-01 Thread taranta
Hi, For this version of kafka-2.0.0 the file topic is empty, so don't work also the first example "QUIKSTART" Step 3: Create A Topic Let's create a topic named "test" with a single partition and only one replica: 1 > bin/kafka-topics.sh --create --zoo

Re: Asking about how to consume the message from follower partition

2018-10-01 Thread Ryanne Dolan
I'm not sure whether this is what the OP is asking for, but some partitioned systems let you select a specific follower to consume from _instead_ of from the leader, e.g. couchbase, which can be useful in scenarios where there are a ton more consumers than producers for a partition, and you don't w

Re: KafkaStreams: ProducerFencedException causing StreamThread death

2018-10-01 Thread Aravind Dongara
Thanks Guozhang, Yes we are hitting the same issue. I see in that ticket that it’s fixed in 1.1.2, 2.0.1, 2.1.0, but I don’t see those versions in here https://kafka.apache.org/downloads on the Kafka download page. How can we get access to any of these versions? Thanks Aravind > On Sep 30,

Re: Asking about how to consume the message from follower partition

2018-10-01 Thread Matthias J. Sax
It's a valid feature request. I was just describing the current implementation that does not support reading from followers. -Matthias On 10/1/18 9:06 AM, Ryanne Dolan wrote: > I'm not sure whether this is what the OP is asking for, but some > partitioned systems let you select a specific follow

Streams meetup@LinkedIn (Oct 23)

2018-10-01 Thread Efe Gencer
Hi Kafka users and developers, We are going to host our quarterly Stream Processing Meetup@LinkedIn on Oct 23. There will be talks about Cruise Control, Stream Analytics Manager, and Apache Samza. Please check the details below if you are interested: https://www.meetup.com/Stream-Processing-Meet

Re: KafkaStreams: ProducerFencedException causing StreamThread death

2018-10-01 Thread Guozhang Wang
Hi Aravind, The tagged versions may not be released yet, we just tag them when the corresponding fix commit is merged to the branch (e.g. 1.1.x, 2.0.x, etc). The next release that will include this commit is 2.1.0, whose feature freeze date is today: https://mail.google.com/mail/u/0/#search/Dong+

Re: Deleting Kafka consumer offset topic.log files

2018-10-01 Thread Kaushik Nambiar
Hello, Any updates on the issue? Regards, Kaushik Nambiar On Wed, Sep 26, 2018, 12:37 PM Kaushik Nambiar wrote: > Hello, > > I am using an SSL Kafka v 0.11.xx on a Linux operating system. > > I can see in the log files that the topic segments are getting deleted > regularly. > The concern I am

Re: Deleting Kafka consumer offset topic.log files

2018-10-01 Thread naresh Goud
Is this helps? https://stackoverflow.com/questions/42546501/the-retention-period-for-offset-topic-of-kafka/44277227#44277227 On Mon, Oct 1, 2018 at 2:31 PM Kaushik Nambiar wrote: > Hello, > Any updates on the issue? > > > Regards, > Kaushik Nambiar > > On Wed, Sep 26, 2018, 12:37 PM Kaushik Na

Kafka consumer error in storm topology

2018-10-01 Thread Bala
Not sure if this is a kafka issue,but I am seeing this on a kerberized cluster and seeing this exception in kafka spout.  java.nio.channels.ClosedChannelException: null     at kafka.network.BlockingChannel.send(BlockingChannel.scala:122) ~[stormjar.jar:?]     at kafka.consumer.SimpleCons

Reliable topic deletion in multi-tenant environment

2018-10-01 Thread Adam Elliott
Hi, My team runs a multi-tenant Kafka cluster with a lot of diverse uses, and one of the services we provide is an API for managed topic creation/deletion. The cluster is large (> 100 nodes) and so it's pretty likely that, for whatever reason, at least one node will be down at any given point--and

Re: [DISCUSS] Apache Kafka 2.1.0 Release Plan

2018-10-01 Thread Dong Lin
Hey everyone, Hope things are going well! Just a kind reminder that the feature freeze time is end of day today. Major features (e.g. KIP implementation) need to be merged and minor features need to be have PR ready. After today I will move pending JIRAs to the next release as appropriate. Cheer