That's a tough call -- you can also come up with scenarios where you'd rather have it read-only than completely dead.
On Wed, Aug 11, 2010 at 12:38 PM, Ran Tavory <ran...@gmail.com> wrote: > Due to administrative error one of the hosts in the cluster lost permission > to write to it's data directory. > So I started seeing errors in the log, however, the server continued serving > traffic. It wasn't able to compact and do other write operations but it > didn't crash. > I was wondering wether that's by design and if so, is this a good one... I > guess I want to know if really bad things happen to my cluster... > logs look like that... > > INFO [FLUSH-TIMER] 2010-08-11 07:53:14,683 ColumnFamilyStore.java (line > 357) KvAds has reached its threshold; switching in a fresh Memtable at > CommitLogContext(file='/outbrain/cassandra/commitlog/Commi > tLog-1281505164614.log', position=88521163) > INFO [FLUSH-TIMER] 2010-08-11 07:53:14,683 ColumnFamilyStore.java (line > 609) Enqueuing flush of Memtable(KvAds)@851225759 > INFO [FLUSH-WRITER-POOL:1] 2010-08-11 07:53:14,684 Memtable.java (line 148) > Writing Memtable(KvAds)@851225759 > ERROR [FLUSH-WRITER-POOL:1] 2010-08-11 07:53:14,688 > DebuggableThreadPoolExecutor.java (line 94) Error in executor futuretask > java.util.concurrent.ExecutionException: java.lang.RuntimeException: > java.io.FileNotFoundException: > /outbrain/cassandra/data/outbrain_kvdb/KvAds-tmp-249-Data.db (Permission > denied) > at > java.util.concurrent.FutureTask$Sync.innerGet(FutureTask.java:222) > at java.util.concurrent.FutureTask.get(FutureTask.java:83) > at > org.apache.cassandra.concurrent.DebuggableThreadPoolExecutor.afterExecute(DebuggableThreadPoolExecutor.java:86) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:888) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:619) > Caused by: java.lang.RuntimeException: java.io.FileNotFoundException: > /outbrain/cassandra/data/outbrain_kvdb/KvAds-tmp-249-Data.db (Permission > denied) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) > at > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441) > at > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) > at java.util.concurrent.FutureTask.run(FutureTask.java:138) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > ... more -- Jonathan Ellis Project Chair, Apache Cassandra co-founder of Riptano, the source for professional Cassandra support http://riptano.com