Is this helps? https://stackoverflow.com/questions/42546501/the-retention-period-for-offset-topic-of-kafka/44277227#44277227
On Mon, Oct 1, 2018 at 2:31 PM Kaushik Nambiar <kaushiknambia...@gmail.com> wrote: > Hello, > Any updates on the issue? > > > Regards, > Kaushik Nambiar > > On Wed, Sep 26, 2018, 12:37 PM Kaushik Nambiar <kaushiknambia...@gmail.com > > > wrote: > > > Hello, > > > > I am using an SSL Kafka v 0.11.xx on a Linux operating system. > > > > I can see in the log files that the topic segments are getting deleted > > regularly. > > The concern I am having is for the system topic which is > __consumer_offset > > , the segments are not getting deleted. > > > > So that's contributing to a large amount of data getting accumulated on > > our disks. > > I can see many sufficiently old .log files sizing around 100mb each. Due > > to many such files in the __consumer_offset topic the disk is getting > maxed > > out. > > > > I had raised similar queries earlier to check if there is a > > misconfiguration ,but the requests were not processed to completion. > > > > So as a quick fix,is it safe to delete the .log files in the > > __consumer_offset topic? > > If yes can u tell me how that can be done. > > > > If not can u suggest me another fix which can be tried? > > > > I have attached my server.properties for reference. > > > > Your responses are highly appreciated. > > > > > > Thankyou, > > Kaushik Nambiar > > > > > > > > > > > > > -- Thanks, Naresh www.linkedin.com/in/naresh-dulam http://hadoopandspark.blogspot.com/
