Hey there, We've trying out Cassandra-2.1.1 and facing the below exception frequently, mainly during the node reboot. File is there with proper permissions (as below), not sure why C* is not able to find it.
>>> ERROR [OptionalTasks:1] 2014-09-27 16:00:20,888 CassandraDaemon.java:167 - Exception in thread Thread[OptionalTasks:1,5,main] java.lang.RuntimeException: java.io.FileNotFoundException: /var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:59) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.io.sstable.SSTableReader.openDataReader(SSTableReader.java:1881) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.io.sstable.SSTableScanner.<init>(SSTableScanner.java:67) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.io.sstable.SSTableReader.getScanner(SSTableReader.java:1646) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.db.RowIteratorFactory.getIterator(RowIteratorFactory.java:67) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.db.ColumnFamilyStore.getSequentialIterator(ColumnFamilyStore.java:1920) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:2035) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.db.ColumnFamilyStore.getRangeSlice(ColumnFamilyStore.java:1969) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.db.HintedHandOffManager.scheduleAllDeliveries(HintedHandOffManager.java:513) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.db.HintedHandOffManager.access$000(HintedHandOffManager.java:93) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.db.HintedHandOffManager$1.run(HintedHandOffManager.java:174) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.concurrent.DebuggableScheduledThreadPoolExecutor$UncomplainingRunnable.run(DebuggableScheduledThreadPoolExecutor.java:75) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) [na:1.7.0_65] at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:304) [na:1.7.0_65] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:178) [na:1.7.0_65] at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293) [na:1.7.0_65] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) [na:1.7.0_65] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) [na:1.7.0_65] at java.lang.Thread.run(Thread.java:745) [na:1.7.0_65] Caused by: java.io.FileNotFoundException: /var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db at org.apache.cassandra.io.util.RandomAccessReader.<init>(RandomAccessReader.java:66) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.io.compress.CompressedRandomAccessReader.<init>(CompressedRandomAccessReader.java:76) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] at org.apache.cassandra.io.compress.CompressedRandomAccessReader.open(CompressedRandomAccessReader.java:55) ~[apache-cassandra-2.1.1-SNAPSHOT.jar:2.1.1-SNAPSHOT] ... 18 common frames omitted ^C $ ll /var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db -rw-r--r-- 1 cassandra root 5305 Sep 27 00:57 /var/lib/cassandra/data/system/hints-2666e20573ef38b390fefecf96e8f0c7/la-12756-Data.db