Re: Large number of tiny sstables flushed constantly

2021-08-11 Thread Erick Ramirez
4 flush writers isn't bad since the default is 2. It doesn't make a difference if you have fast disks (like NVMe SSDs) because only 1 thread gets used. But if flushes are slow, the work gets distributed to 4 flush writers so you end up with smaller flush sizes although it's difficult to tell how t

Re: Large number of tiny sstables flushed constantly

2021-08-11 Thread Jiayong Sun
Hi Erick, Thanks for your response.Actually we did not set the memtable_cleanup_threshold in the cassandra.yaml.However, we have memtable_flush_writers: 4 defined in the yaml, and VM node has 16-core.Any advice for this param's value? Thanks again.Jiayong SunOn Tuesday, August 10, 2021, 09:2

Re: Large number of tiny sstables flushed constantly

2021-08-11 Thread Jiayong Sun
Hi Erick, The nodes have 4 SSD (1TB for each but we only use 2.4TB of space. Current disk usage is about 50%) with RAID0. Based on number of disks we increased  memtable_flush_writers: 4 instead of default of 2. For the following we set:- max heap size - 31GB- memtable_heap_space_in_mb (use defa