tches?
> >
> > Thanks
> > Uddhav
> >
> > On Wed, Feb 14, 2018 at 6:05 PM, Manikumar
> > wrote:
> >
> > > If the broker "compression.type" is "producer", then the broker
> retains
> > > the original compression codec
codec set by the producer.
> > If the producer and broker codecs are different, then broker recompress
> > the data using broker "compression.type".
> >
> > On Wed, Feb 14, 2018 at 10:58 AM, Uddhav Arote
> > wrote:
> >
> > > Hi Kafka user
ype".
>
> On Wed, Feb 14, 2018 at 10:58 AM, Uddhav Arote
> wrote:
>
> > Hi Kafka users,
> >
> > I am trying to understand the behavior of compression in Kafka. Consider
> a
> > scenario, where producer sets compression.codec "snappy" and bro
10:58 AM, Uddhav Arote
wrote:
> Hi Kafka users,
>
> I am trying to understand the behavior of compression in Kafka. Consider a
> scenario, where producer sets compression.codec "snappy" and broker's
> compression.code "lz4"?
> In this scenario, what i
Hi Kafka users,
I am trying to understand the behavior of compression in Kafka. Consider a
scenario, where producer sets compression.codec "snappy" and broker's
compression.code "lz4"?
In this scenario, what is the behavior of the compression?
As far as I have underst
On May 7, 2014, at 7:16 AM, Maung Than wrote:
> Hi All,
>
> I have read this posting from linkedIn Team member;
> http://geekmantra.wordpress.com/2013/03/28/compression-in-kafka-gzip-or-snappy/
> ; Thanks.
>
> I have few questions and thoughts:
>
> 4) Has
> http://geekmantra.wordpress.com/2013/03/28/compression-in-kafka-gzip-or-snappy/;
> Thanks.
> >
> > I have few questions and thoughts:
> >
> > 4) Has any one else done Snappy Vs. GZIP comparison and chosen one over
> the other. If so what are your findings an
Hi All,
I have read this posting from linkedIn Team member;
http://geekmantra.wordpress.com/2013/03/28/compression-in-kafka-gzip-or-snappy/
; Thanks.
I have few questions and thoughts:
1) In asynchronous mode, you are compressing the batch, not the individual
send.
2) There is no way
There is no code change needed in the consumer. The message format stores
the compression codec and the consumer library knows how to parse the data.
Thanks,
Jun
On Wed, Jun 5, 2013 at 12:13 AM, Jason Rosenberg wrote:
> In this case, does the consumer code need to change, account for the
> co
In this case, does the consumer code need to change, account for the
compression (or is this handled automatically in the consumer apis?).
If we decide to start compressing messages to a topic, can a consumer
seamlessly move between the transition from uncompressed to compressed?
Jason
On Tue,
Thanks so much Neha
On Tue, Jun 4, 2013 at 9:57 PM, Neha Narkhede wrote:
> The only way of storing compressed data on the server is to have the
> producer send it compressed. The server sends the data in compressed format
> to the consumers.
>
> Thanks,
> Neha
>
>
> On Tue, Jun 4, 2013 at 9:55 P
The only way of storing compressed data on the server is to have the
producer send it compressed. The server sends the data in compressed format
to the consumers.
Thanks,
Neha
On Tue, Jun 4, 2013 at 9:55 PM, Vadim Keylis wrote:
> Good evening. I would like to preserve logs in kafka for 2 days.
Good evening. I would like to preserve logs in kafka for 2 days. Due to the
size of data it must be compressed otherwise it will take enormous amount
of disk space. Its my understanding that the only way to store messages in
kafka compressed is to enable compression on the producer side, is that
co
13 matches
Mail list logo
