There is quite a nice section on this in the documentation - http://kafka.apache.org/documentation/#compaction ... I think it should answer your questions.
On Wed, Nov 29, 2017 at 7:19 AM, Kane Kim <kane.ist...@gmail.com> wrote: > How does kafka log compaction work? > Does it compact all of the log files periodically against new changes? >