Re: 10MB message

2016-06-15 Thread James Cheng
Igor, This article talks about what to think about if putting large messages into Kafka: http://ingest.tips/2015/01/21/handling-large-messages-kafka/ The summary is that Kafka is not optimized for handling large messages, but if you really want to, it's possible to do it. That website is havin

Re: 10MB message

2016-06-14 Thread R Krishna
There are options to compress on the wire and in the topic. On Tue, May 31, 2016 at 8:35 AM, Igor Kravzov wrote: > In our system some data can be as big as 10MB. > Is it OK to send 10 MB message through Kafka? What configuration > parameters should I check/set? > It is going to be one topic wit