Hi,

I'm having significant problems getting the kafka consumer to operate 
deterministically with small message numbers & sizes (this is for local 
testing).

I'm controlling the offset manually, and using manual partition/topic 
assignment. I've set auto commit off, and set fetch.min.bytes to 1.

However, with 2 small (4-byte) messages in the queue, calling poll(0) on the 
consumer does not return them - it returns an empty list. poll(1) doesn't 
always return the messages either (sometimes it does, sometimes it doesn't).

How do I get the consumer to operate entirely deterministically - so that when 
I call poll(n) it is guaranteed to return all the messages available in the 
queue at that point, regardless of how small they are or how few messages there 
are in the queue, without blocking?

Thanks,
SimonC

Reply via email to