At LinkedIn we have a number of use cases for large messages. We stick to the 1MB message limit at the high end though.
Nacho On Tue, Nov 22, 2016 at 6:11 PM, Gwen Shapira <g...@confluent.io> wrote: > This has been our experience as well. I think the largest we've seen > in production is 50MB. > > If you have performance numbers you can share for the large messages, > I think we'll all appreciate :) > > On Tue, Nov 22, 2016 at 1:04 PM, Tauzell, Dave > <dave.tauz...@surescripts.com> wrote: > > I ran tests with a mix of messages, some as large as 20MB. These large > messages do slow down processing, but it still works. > > > > -Dave > > > > -----Original Message----- > > From: h...@confluent.io [mailto:h...@confluent.io] > > Sent: Tuesday, November 22, 2016 1:41 PM > > To: users@kafka.apache.org > > Subject: Re: Oversized Message 40k > > > > The default config handles messages up to 1MB so you should be fine. > > > > -hans > > > >> On Nov 22, 2016, at 4:00 AM, Felipe Santos <felip...@gmail.com> wrote: > >> > >> I read on documentation that kafka is not optimized for big messages, > >> what is considered a big message? > >> > >> For us the messages will be on average from 20k ~ 40k? Is this a real > >> problem? > >> > >> Thanks > >> -- > >> Felipe Santos > > This e-mail and any files transmitted with it are confidential, may > contain sensitive information, and are intended solely for the use of the > individual or entity to whom they are addressed. If you have received this > e-mail in error, please notify the sender by reply e-mail immediately and > destroy all copies of the e-mail and any attachments. > > > > -- > Gwen Shapira > Product Manager | Confluent > 650.450.2760 | @gwenshap > Follow us: Twitter | blog > -- Nacho - Ignacio Solis - iso...@igso.net
