Re: Kafka 0.9 -> consumer.poll() occasionally returns 0 elements

Jason, My os/vm is OSX 10.11.3, JDK 1.8.0.40 —  Krzysztof On 26 January 2016 at 19:04:58, Jason Gustafson (ja...@confluent.io) wrote: Hey Krzysztof, So far I haven't had any luck figuring out the cause of the 5 second pause, but I've reproduced it with the old consumer on 0.8.2, so that rul

Re: facade libs for kafka?

Hi Andrew, I’m the main maintainer of Reactive-Kafka which wraps Kafka as a sink/source of a Reactive Stream. Maybe it will suit your needs: https://github.com/softwaremill/reactive-kafka Java API is also available. —  Bests, Krzysiek SoftwareMill On 26 January 2016 at 22:10:13, Andrew Pennebak

Re: Kafka 0.9 -> consumer.poll() occasionally returns 0 elements

Hi Jason, Lowering "receive.buffer.bytes” helps, but when the message size gets bigger - it comes back again. I will test with 65536 and check how big the message has to be to make the issue reappear with this value (I suspect that quite big). --  Krzysztof Ciesielski SoftwareMill

Re: Kafka 0.9 -> consumer.poll() occasionally returns 0 elements

t's sent to the client. Can you create > a JIRA? > > Thanks, > Jason > > > > On Thu, Jan 21, 2016 at 11:30 AM, Samya Maiti > wrote: > > > +1, facing same issue. > > -Sam > > > On 22-Jan-2016, at 12:16 am, Krzysztof Ciesielski < > > krzys

Kafka 0.9 -> consumer.poll() occasionally returns 0 elements

Hello, I'm running into an issue with the new consumer in Kafka 0.9.0.0. Here's a runnable gist illustrating the problem: https://gist.github.com/kciesielski/054bb4359a318aa17561 (requires Kafka on localhost:9092) Scenario description: First, a producer writes 50 elements into a topic Then, a

Reactive Kafka now supports Kafka 0.9

Hi there, I'd like to announce that our open source library, Reactive Kafka (which wraps Akka Streams for Java/Scala around Kafka consumers/producers), now supports Kafka 0.9. More details: https://softwaremill.com/reactive-kafka-09/

Re: New Consumer API + Reactive Kafka

call poll(); the old consumer had a background thread doing this which would only stop when it filled up a queue of unprocessed chunks...this is a lot harder to predict. -Jay On Wed, Dec 2, 2015 at 7:13 AM, Gwen Shapira wrote: > On Wed, Dec 2, 2015 at 10:44 PM, Krzysztof Ci

New Consumer API + Reactive Kafka

Hello, I’m the main maintainer of Reactive Kafka - a wrapper library that provides Kafka API as Reactive Streams (https://github.com/softwaremill/reactive-kafka). I’m a bit concerned about switching to Kafka 0.9 because of the new Consumer API which doesn’t seem to fit well into this paradigm, c