Re: Verify log compaction

2016-08-11 Thread Harald Kirsch
In case you are on Windows: compaction plainly does not work. See https://issues.apache.org/jira/browse/KAFKA-1194 Root cause seems to be Windows' file locking and Kafka trying to delete/rename files that are open in another thread/part of the broker. Harald. On 11.08.2016 07:38, David Yu wr

Re: Verify log compaction

2016-08-10 Thread David Yu
For some reason, I cannot find log-cleaner.log anywhere. On Fri, Jul 29, 2016 at 8:20 PM John Holland < john.holl...@objectpartners.com> wrote: > Check the log-cleaner.log file on the server. When the thread runs you'll > see output for every partition it compacts and the compaction ratio it > a

Re: Verify log compaction

2016-07-29 Thread John Holland
Check the log-cleaner.log file on the server. When the thread runs you'll see output for every partition it compacts and the compaction ratio it achieved. The __consumer_offsets topic is compacted, I see log output from it being compacted frequently. Depending on your settings for the topic it m

Verify log compaction

2016-07-29 Thread David Yu
Hi, We are using Kafka 0.9.0.0. One of our topic is set to use log compaction. We have also set log.cleaner.enable. However, we suspected that the topic is not being compacted. What is the best way for us to verify the compaction is happening? Thanks, David