Re: offset topics growing huge

2016-10-07 Thread Tom Crayford
On Mon, Oct 3, 2016 at 5:38 PM, Ali Akhtar wrote: > Newbie question, but what exactly does log.cleaner.enable=true do, and how > do I know if I need to set it to be true? > If you're using any compacted topics (including __consumer_offsets), it needs to be on. > > Also, if config changes like

Re: offset topics growing huge

2016-10-03 Thread Ali Akhtar
Newbie question, but what exactly does log.cleaner.enable=true do, and how do I know if I need to set it to be true? Also, if config changes like that need to be made once a cluster is up and running, what's the recommended way to do that? Do you killall -12 kafka and then make the change, and the

Re: offset topics growing huge

2016-10-03 Thread Tom Crayford
Yes, offset topic compaction is just the normal compaction. Thanks Tom Crayford Heroku Kafka On Monday, 3 October 2016, Tobias Adamson wrote: > Hi > We are using Kafka 0.10.1 with offsets commits being stored inside of Kafka > After a while these topics become extremely large and we are wonder