I'm running benchmark on a 2 nodes C* 2.1.8 cluster using cassandra-stress, with the default of CL =1 Stress runs fine for some time, and than start throwing:
java.io.IOException: Operation x10 on key(s) [36333635504d4b343130]: Error executing: (UnavailableException): Not enough replica available for query at consistency LOCAL_ONE (1 required but only 0 alive) at org.apache.cassandra.stress.Operation.error(Operation.java:216) at org.apache.cassandra.stress.Operation.timeWithRetry(Operation.java:188) at org.apache.cassandra.stress.operations.predefined.CqlOperation.run(CqlOperation.java:99) at org.apache.cassandra.stress.operations.predefined.CqlOperation.run(CqlOperation.java:107) at org.apache.cassandra.stress.operations.predefined.CqlOperation.run(CqlOperation.java:259) at org.apache.cassandra.stress.StressAction$Consumer.run(StressAction.java:309) The problem disappears when I decrease the number of client threads, but my goal is to test max performance, so lowering the bar defeat my purpose. Is this normal server push back under too much pressure? shouldn't the stress client slow down before this happened? Thanks Tzach