Normally, I see 2-4 log segments deleted every hour in my brokers. I see log lines like this:
2013-05-23 04:40:06,857 INFO [kafka-logcleaner-0] log.LogManager - Deleting log segment 00000000035434043157.kafka from <redacted topic> However, it seems like if I restart the broker, a massive amount of disk space is freed (without a corresponding flood of these log segment deleted messages). Is there an explanation for this? Does kafka keep reference to file segments around, and reuse them as needed or something? And then or restart, the references to those free segment files are dropped? Thoughts? This is with 0.7.2. Jason