That's great news. Will be keeping an eye on the release.
On Mon, Aug 8, 2016 at 10:12 AM Jacob Maes
wrote:
> Hey David,
>
> I think that behavior is meant to prevent an issue on the Kafka 0.8
> Brokers. Samza 10.1 allows compression on log compacted topics, but you'll
> need to make sure you're
Hey David,
I think that behavior is meant to prevent an issue on the Kafka 0.8
Brokers. Samza 10.1 allows compression on log compacted topics, but you'll
need to make sure you're using Kafka 0.9 or higher on the Brokers.
-Jake
On Fri, Aug 5, 2016 at 10:57 PM, David Yu wrote:
> I guess this mig
I guess this might be the problem:
2016-08-06 05:23:23,622 [main ] WARN o.a.s.s.kafka.KafkaSystemFactory$ -
System name 'kafka' is being used as a changelog. Disabling compression
since Kafka does not support compression for log compacted topics.
Is this a 0.8.x.x Kafka producer limitation?
On
Hey David,
If you check your container logs Kafka should print the producer config
> 2016-08-05 19:18:30.134 [main] ProducerConfig [INFO] ProducerConfig values:
> compression.type = gzip
...
If you see the correct compression type in that config, then the Kafka
producer definitely has compressi
I'm reporting back my observations after enabling compression.
Looks like compression is not doing anything. I'm still seeing
"compression-rate-avg=1.0" and the same "record-size-avg" from JMX
"kafka.producer" metrics.
I did set the following:
systems.kafka.producer.compression.type=snappy
Am I
Great. Thx.
On Wed, Aug 3, 2016 at 1:42 PM Jacob Maes wrote:
> Hey David,
>
> what gets written to the changelog topic
>
> The changelog gets the same value as the store, which is the serialized
> form of the key and value. The serdes for the store are configured with the
> properties:
> stores.
Hey David,
what gets written to the changelog topic
The changelog gets the same value as the store, which is the serialized
form of the key and value. The serdes for the store are configured with the
properties:
stores.store-name.key.serde
stores.store-name.msg.serde
If I want to compress the ch
