Daning, You could clear the hintedhandoff via jmx ( HintedHandOffManagerMBean.deleteHintsForEndpoint ) for that host. Feng Qu
>________________________________ > From: Daning Wang <dan...@netseer.com> >To: user@cassandra.apache.org >Sent: Wednesday, May 16, 2012 10:38 AM >Subject: Re: Couldn't find cfId > > >Thanks Aaron! We will upgrade to 1.0.9. > >Just curious, you said "removing the HintedHandoff files from data/system", >what do the HintedHandoff files look like? > >Thanks, > >Daning > > >On Wed, May 16, 2012 at 2:32 AM, aaron morton <aa...@thelastpickle.com> wrote: > >Looks like this https://issues.apache.org/jira/browse/CASSANDRA-3975 >> >> >>Fixed in the latest 1.0.9. >> >> >>Either upgrade (which is always a good idea) or purge the hints from the >>server. Either using JMX or stopping the node and removing the HintedHandoff >>files from data/system. >> >> >>In either case you should then run a nodetool repair as hints for other CF's >>may have been dropped. >> >> >>Cheers >> >> >> >>----------------- >>Aaron Morton >>Freelance Developer >>@aaronmorton >>http://www.thelastpickle.com >> >> >>On 16/05/2012, at 2:27 AM, Daning Wang wrote: >> >>We got exception "UnserializableColumnFamilyException: Couldn't find >>cfId=1075" in the log of one node, describe cluster showed all the nodes in >>same schema version. how to fix this problem? did repair but looks does not >>work, haven't try scrub yet. >>> >>> >>>We are on v1.0.3 >>> >>> >>>ERROR [HintedHandoff:1631] 2012-05-15 07:13:07,877 >>>AbstractCassandraDaemon.java (line 139) Fatal exception in thread >>>Thread[HintedHandoff:1631,1,main] >>>java.lang.RuntimeException: >>>org.apache.cassandra.db.UnserializableColumnFamilyException: Couldn't find >>>cfId=1075 >>> at >>>org.apache.cassandra.utils.FBUtilities.unchecked(FBUtilities.java:689) >>> at >>>org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:34) >>> at >>>java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1110) >>> at >>>java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:603) >>> at java.lang.Thread.run(Thread.java:722) >>>Caused by: org.apache.cassandra.db.UnserializableColumnFamilyException: >>>Couldn't find cfId=1075 >>> at >>>org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:129) >>> at >>>org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:401) >>> at >>>org.apache.cassandra.db.RowMutation$RowMutationSerializer.deserialize(RowMutation.java:409) >>> at >>>org.apache.cassandra.db.HintedHandOffManager.deliverHintsToEndpointInternal(HintedHandOffManager.java:344) >>> at >>>org.apache.cassandra.db.HintedHandOffManager.deliverHintsToEndpoint(HintedHandOffManager.java:248) >>> at >>>org.apache.cassandra.db.HintedHandOffManager.access$200(HintedHandOffManager.java:84) >>> at >>>org.apache.cassandra.db.HintedHandOffManager$3.runMayThrow(HintedHandOffManager.java:418) >>> >>>Thanks, >>> >>> >>>Daning >> > > >
