There is someone wrong with the way a composite type value was serialized. The length of a part on disk is not right.
As a work around remove the log file, restart and then repair the node. How it got like that is another question. What was the schema change ? Cheers ----------------- Aaron Morton Freelance Developer @aaronmorton http://www.thelastpickle.com On 26/01/2012, at 7:08 AM, huyle wrote: > Hi, > > I am having similar or the same issue on single node environment. I did > make schema changes recently. Any recommendation how to recover the server > without loosing data? Here are the last few lines of debug log during start > up. > > -3881-11e1-ac7f-12313d23ead3:true:4@1326223353559001,])} > DEBUG 18:02:01,057 Reading mutation at 66336992 > DEBUG 18:02:01,058 replaying mutation for > Springpad.696d6167652d7363616c65722d6d657461: > {ColumnFamily(CassandraOrderedQueue > [0,eb321490-3881-11e1-ac7f-12313d23ead3:true:4@1326223353560000,])} > DEBUG 18:02:01,058 Reading mutation at 66337118 > DEBUG 18:02:01,058 replaying mutation for > Springpad.737072696e674d6f64656c44617461626173652d6d657461: > {ColumnFamily(CassandraOrderedQueue > [0,80dc0cd0-3bc0-11e1-83a8-12313d23ead3:false:8@1326223386668000,])} > DEBUG 18:02:01,058 Reading mutation at 66337255 > DEBUG 18:02:01,058 replaying mutation for > system.38363233616337302d336263302d313165312d303030302d323366623834646463346633: > {ColumnFamily(Schema > [Avro/Schema:false:2725@1326223386807,Backups:false:431@1326223386807,Springpad:false:10814@1326223386807,SpringpadGraph:false:2931@1326223386807,])} > DEBUG 18:02:01,059 Reading mutation at 66354352 > DEBUG 18:02:01,059 replaying mutation for > system.4d6967726174696f6e73204b6579: {ColumnFamily(Migrations > [8623ac70-3bc0-11e1-0000-23fb84ddc4f3:false:23728@1326223386812,])} > DEBUG 18:02:01,059 Reading mutation at 66378184 > DEBUG 18:02:01,059 replaying mutation for > system.4c617374204d6967726174696f6e: {ColumnFamily(Schema [Last > Migration:false:16@1326223386812,])} > DEBUG 18:02:01,059 Reading mutation at 66378302 > INFO 18:02:01,060 Finished reading > /mnt/cassandra/commitlog/CommitLog-1325861435420.log > ERROR 18:02:01,061 Exception encountered during startup > java.lang.IllegalArgumentException > at java.nio.Buffer.limit(Buffer.java:247) > at > org.apache.cassandra.db.marshal.AbstractCompositeType.getBytes(AbstractCompositeType.java:57) > at > org.apache.cassandra.db.marshal.AbstractCompositeType.getWithShortLength(AbstractCompositeType.java:66) > at > org.apache.cassandra.db.marshal.AbstractCompositeType.getString(AbstractCompositeType.java:129) > at org.apache.cassandra.db.Column.getString(Column.java:250) > at > org.apache.cassandra.db.marshal.AbstractType.getColumnsString(AbstractType.java:137) > at org.apache.cassandra.db.ColumnFamily.toString(ColumnFamily.java:280) > at org.apache.commons.lang.ObjectUtils.toString(ObjectUtils.java:241) > at org.apache.commons.lang.StringUtils.join(StringUtils.java:3073) > at org.apache.commons.lang.StringUtils.join(StringUtils.java:3133) > at > org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:301) > at > org.apache.cassandra.db.commitlog.CommitLog.recover(CommitLog.java:172) > at > org.apache.cassandra.service.AbstractCassandraDaemon.setup(AbstractCassandraDaemon.java:215) > at > org.apache.cassandra.service.AbstractCassandraDaemon.activate(AbstractCassandraDaemon.java:356) > at > org.apache.cassandra.thrift.CassandraDaemon.main(CassandraDaemon.java:107) > Exception encountered during startup: null > > > > Thanks! > > Huy > > > -- > View this message in context: > http://cassandra-user-incubator-apache-org.3065146.n2.nabble.com/Cannot-start-cassandra-node-anymore-tp7150978p7224570.html > Sent from the cassandra-u...@incubator.apache.org mailing list archive at > Nabble.com.
