i run tests with this command:
bin/kafka-producer-perf-test.sh --topic topicname --num-records 5
--throughput -1 --producer.config config/producer.properties --record-size
64
śr., 12 wrz 2018 o 13:38 Liam Clarke napisał(a):
> 500 million * 64B is 32GB. Are you sure you actually sent 500
500 million * 64B is 32GB. Are you sure you actually sent 500 million
messages? (I assumed that mln = million)
On Wed, 12 Sep. 2018, 9:54 pm darekAsz, wrote:
> sorry, I wrote bad results :/
> here are correctly
>
> Directory size after sending uncompressed data: 1.5 GB
>
> Directory size after s
sorry, I wrote bad results :/
here are correctly
Directory size after sending uncompressed data: 1.5 GB
Directory size after sending data compressed with gzip: 1.2 GB
Directory size after sending data compressed with snappy: 366 MB
Directory size after sending data compressed with lz4: 2.4 GB
It's not just lz4 , except in case if gzip everything else increases the
directory size.
-Original Message-
From: darekAsz
Sent: Wednesday, September 12, 2018 2:43 PM
To: users@kafka.apache.org
Subject: Kafka compression - results
Hi
I made some tests of compression in kafka. First I
