Also, have you looked at the use of the max wait time in fetch requests ( fetch.max.wait.ms for the new consumer)? The broker will hold the fetch in purgatory until data is available. Sort of lets you fake a push model.
-Jason On Tue, Jan 31, 2017 at 2:29 PM, radai <radai.rosenbl...@gmail.com> wrote: > minimizing the cost of clients is part of what makes kafka scale. > a push model would shift a lot of tracking logic onto the broker. > > On Tue, Jan 31, 2017 at 2:47 AM, Alexander Binzberger < > alexander.binzber...@wingcon.com> wrote: > > > way it seams like the protocol and the high-level consumer would be > > simplified. > > Clients have a more natural control over the offset and could ack per > > message or per bulk as needed or performance allows. > > Additionally the stream processing path over > > >
