Why do some people recommend breaking large messages into many smaller ones?

2020-01-03 Thread Clark Sims
Why do some people so strongly recommend cutting large messages into many small messages, as opposed to changing max.message.bytes? For example, Stéphane Maarek at https://www.quora.com/How-do-I-send-Large-messages-80-MB-in-Kafkam, says "Kafka isn’t meant to handle large messages and that’s why th

maximum lag between current offset, and last commit

2020-01-08 Thread Clark Sims
I liked this article: https://blog.newrelic.com/engineering/kafka-consumer-config-auto-commit-data-loss/ I particularly like the illustration in the article: http://newrelic-wpengine.netdna-ssl.com/wp-content/uploads/offset_explained2.jpg What is the maximum difference between the current offset i

Re: maximum lag between current offset, and last commit

2020-01-08 Thread Clark Sims
offset, and last confirmed offset. Regards, Clark On Wed, Jan 8, 2020 at 11:55 AM Clark Sims wrote: > > I liked this article: > https://blog.newrelic.com/engineering/kafka-consumer-config-auto-commit-data-loss/ > I particularly like the illustration in the article: >

Fwd: unsubscribe

2023-11-11 Thread Clark Sims
...@kafka.apache.org. I think there is a bug in ther server. It isn't working for me. Thanks, Clark -- Forwarded message - From: Clark Sims Date: Sun, Sep 3, 2023 at 1:03 PM Subject: unsubscribe To: unsubscribe