Re: [VOTE] Add REST Server to Apache Kafka

2016-10-29 Thread Harsha Chintalapani
This Vote now closed. There is the majority who are not in favor of including the REST server. Thanks everyone for participating. Vote tally: +1 Votes: Harsha Chintalapani Parth Brahbhatt Ken Jackson Suresh Srinivas Jungtaek Lim Ali Akthar Haohui Mai Shekhar Tippu

Re: Kafka client circuit breaker

2016-10-29 Thread R Krishna
What are the issues and problems you want to solve though? On Oct 29, 2016 3:59 AM, "Andrey Dyachkov" wrote: > Hi, > > We use Kafka for around half a year as a main backend system for storing > events from big variety of internal microservices. In general It works > quite well and we experience i

Re: [VOTE] Add REST Server to Apache Kafka

2016-10-29 Thread Gwen Shapira
Oops. Sorry, didn't notice the 72h voting period has passed. You can disregard. Gwen On Sat, Oct 29, 2016 at 4:29 PM, Gwen Shapira wrote: > -1 > > Kafka's development model is a good fit for critical path and > well-established APIs. It doesn't work as well for add-ons that need to > rapidly ev

"Attempt to heart beat failed since the group is rebalancing, try to re-join group" errors

2016-10-29 Thread jelmer
Hi We run kafka 0.10.0.1 on the server And recently upgraded a client that used the kafka 0.8.2 java client to use kafka client 0.9.0.1 We previously had fetch.message.max.bytes set to 11534336 This ended up crashing in production with org.apache.kafka.common.errors.RecordTooLargeException: The

Re: [VOTE] Add REST Server to Apache Kafka

2016-10-29 Thread Gwen Shapira
-1 Kafka's development model is a good fit for critical path and well-established APIs. It doesn't work as well for add-ons that need to rapidly evolve. Merging communities with different development pace and models rarely ends well - I think the REST Proxy will benefit from being a separate proje

Increasing producer throughput

2016-10-29 Thread Dominik Safaric
Dear all, As my team is in the process of benchmarking several stream processing engines consuming data from Kafka, I’ve been investigating onto boosting the Kafka producer throughput. For running Kafka we use a single node with a single broker configuration. Kafka heap size is set to 4GB. Al

Kafka client circuit breaker

2016-10-29 Thread Andrey Dyachkov
Hi, We use Kafka for around half a year as a main backend system for storing events from big variety of internal microservices. In general It works quite well and we experience issues only in some rare 'corner cases' where we either run against a bug or do not understand why Kafka behaves in parti

Re: Problem with timestamp in Producer

2016-10-29 Thread Debasish Ghosh
Hello Mathias - Regarding .. In case you do have 0.10 brokers, it might however happen, that bin/kafka-console-producer.sh > does use 0.9 producer. How can I check this ? Thanks! On Sat, Oct 29, 2016 at 12:23 PM, Debasish Ghosh wrote: > I agree .. the problem is DC/OS still ships the older