Help with Mirror Maker config to produce to all partitions in target cluster

2017-10-27 Thread Chris Neal
Hi all, I've been struggling with this for awhile and need some help please. :) I have a source cluster running Kafka 0.8.1.1 with about 900 topics. I have a target cluster running Kafka 0.10.2 with those same topics pre-created with the same number of partitions per topic as the source cluster.

Re: Kafka Event Acknowledgement

2017-10-27 Thread Hemambika Hema
we are using kafka_2.10-0.10.0.1 version On Fri, Oct 27, 2017 at 8:45 PM, Hemambika Hema wrote: > Hello, > > > I have installed Kafka using the tar file > > created a topic and able to send messages from producer to consumer > > here, can we have a acknowledgment to the message sent from procedu

Kafka Event Acknowledgement

2017-10-27 Thread Hemambika Hema
Hello, I have installed Kafka using the tar file created a topic and able to send messages from producer to consumer here, can we have a acknowledgment to the message sent from procedure to consumer... if yes,it would be helpful for us to know how to do it and where to see the acknowledgment m

Kafka producer/consumer quotas (Kafka 0.10)

2017-10-27 Thread karan alang
I've Kafka 0.10 .. I've set the following in kafka broker.properties & restarted the brokers - quota.producer.default=10485760 quota.consumer.default=10485760 when i fire the following command, i was expecting to see the quota limits : /bin/kafka-configs --zookeeper localhost:3181 --describe -

Re: Kafka Event Acknowledgement

2017-10-27 Thread Ted Yu
This seems related to your question: https://www.confluent.io/blog/exactly-once-semantics-are-possible-heres-how-apache-kafka-does-it/ On Fri, Oct 27, 2017 at 8:22 AM, Hemambika Hema wrote: > we are using kafka_2.10-0.10.0.1 version > > On Fri, Oct 27, 2017 at 8:45 PM, Hemambika Hema > > wrote

[VOTE] 1.0.0 RC4

2017-10-27 Thread Guozhang Wang
Hello Kafka users, developers and client-developers, This is the fifth candidate for release of Apache Kafka 1.0.0. The main PRs that gets merged in after RC3 are the following: *https://github.com/apache/kafka/commit/def1a768a6301c14ad6611358716ab03de04e76b

Call for Paper: Kafka Summit London 2018

2017-10-27 Thread Gwen Shapira
Hi Kafka Users and Contributors, We are having the first ever Kafka Summit that is really close to Europe even if not quite part of Europe. Call for papers is now open and you should all submit abstracts and tell your colleagues to submit abstracts too! Seriously, if you use Kafka, whether beginn

Producer performance is awful when acks=all

2017-10-27 Thread Vijay Prakash
Hey all, I'm currently running Kafka 0.10.1 on Windows and am doing some perf testing. I tried out the perf test setup described in this blog post: https://engineering.linkedin.com/kafka/benchmarking-apache-kafka-2-million-writes-second-three-cheap-machines. When I try "single producer thread,