>>Offsets.retention.minutes (default is 7 days, not 24 hours). In 0.11.x , default value was 24 hrs, it is changed to 7 days in 2.0[1]. Kaushik mentions that they are using 0.11.xx
1. http://kafka.apache.org/documentation/#upgrade_200_notable On Mon, Sep 24, 2018 at 8:42 PM, Kaushik Nambiar <kaushiknambia...@gmail.com> wrote: > Hello, > Thankyou for your reply. > I have attached a text file containing the data within the server.properties > file. > > Also I could see that it was the .log files within the __consumer_offset > topic that were sizing around 100 mb each. > So due to many such log files,the disk is getting maxed out. > > Your comments on the same. > > Regards, > Kaushik Nambiar > > > On Mon, Sep 24, 2018, 5:06 PM M. Manna <manme...@gmail.com> wrote: >> >> What are your settings for: >> >> 1) Offsets.retention.check.interval.ms >> 2) Offsets.retention.minutes (default is 7 days, not 24 hours). >> >> Also, did this occur even after you restarted any individual brokers? >> Please share the server.properties "As is" for your case. >> >> Regards, >> >> On Mon, 24 Sep 2018 at 12:14, Kaushik Nambiar <kaushiknambia...@gmail.com> >> wrote: >> >> > Hello, >> > I am using a Kafka with version 0.11.xx. >> > When I check the logs I can see the index segments for user defined >> > topics >> > are getting deleted. >> > But I cannot find the indices for the consumer_offset topic getting >> > deleted. >> > That's causing around GBs of data getting accumulated in our persistent >> > disk. >> > Based on the server.properties file,we haven't set any >> > offsets.retention.minutes. >> > So I am assuming the default values would be used which is 24 hours. >> > But still I can find .index files in the __consumer_offsets topic which >> > are >> > months old. >> > Cannot you guys tell me what could be the reason for this. >> > Also a workaround to fix this issue would help too. >> > >> > Any kind of help is greatly appreciated. >> > >> > Regards, >> > Kaushik Nambiar >> >
