Guangle, The deletion of the segment log / index files are async, i.e. when Kafka decide to clean the logs, it only adds a suffix ".deleted" to the files such that it will not be access any more by other Kafka threads. The actual file deletion will be executed later, with period controlled by " file.delete.delay.ms" (default 1 minute).
On Fri, Feb 27, 2015 at 9:49 PM, Guangle Fan <fanguan...@gmail.com> wrote: > Hi, > > After Kafka cleaned .log / .index files based on topic retention. I can > still lsof a lot of .index.deleted files. And df shows usage on disk space > is accumulated to full. > > When this happened, just by restarting broker, it will immediately free > those disk space. I seems to me kafka after cleaning expired files still > hold file descriptors which lead to disk space still being held. > > How do you config kafka to let kafka release file descriptors in this case > ? > > Using kafka 0.8.1.1 > > Regards, > > Guangle > -- -- Guozhang
