There was a JIRA that cold sstables are not compacted leading to thousands of sstables. Issue got fixed in 2.0.4. Which version of Cassandra are you using?
Anuj Sent from Yahoo Mail on Android From:"Jeff Jirsa" <jeff.ji...@crowdstrike.com> Date:Fri, 11 Dec, 2015 at 10:42 pm Subject:Re: Thousands of pending compactions using STCS There were a few buggy versions in 2.1 (2.1.7, 2.1.8, I believe) that showed this behavior. The number of pending compactions was artificially high, and not meaningful. As long as they number of –Data.db sstables remains normal, compaction is keeping up and you’re fine. - Jeff From: Vasileios Vlachos Reply-To: "user@cassandra.apache.org" Date: Friday, December 11, 2015 at 8:28 AM To: "user@cassandra.apache.org" Subject: Thousands of pending compactions using STCS