Hi all, I am trying to bootstrap a node without success due to running out of space. Average node size is 260GB with lots of LCS tables (overall data ~3.5 TB) Each node is also configured with a 1TB disk, including the bootstrapping node.
After 12 hours the bootstrapping node fails with more than 2000 compactions pending. I have tried to increase the compaction threads, un-throttle the throughput, but no luck. Also I've tried reduce the streaming throughput (on all nodes this) as much as possible (1 Mb/sec). The thing is that even if I manage to reduce the streaming throughput, compactions are still piling up leaving me with no other choice than pausing the whole streaming process altogether, which AFAIK is not possible :/ I have searched the mailing list and this https://groups.google.com/forum/#!topic/nosql-databases/GbcFMUUJ7XU reminds me of my current situation. Unfortunately I am still left with the following two questions: 1) Is it possible to pause all streams so to give the boostrapping node enough time to catch up? 2) I don't understand why the disk fills up so fast. Considering the amount of LCS tables I was even ready to blame LCS and the fact that the first compaction at L0 is done with STCS, but 1 TB is way more than twice the amount of data the node should own in theory, so something else might be responsible for the over streaming. Thanks in advance! Stefano Ortolani
