Hi,
After upgrading cluster to 1.0.5
I am having problems connecting to the cluster using hector
Any help will be aprichiated.
Thanks
Michael
me.prettyprint.hector.api.exceptions.HTimedOutException: TimedOutException()
at
me.prettyprint.cassandra.service.ExceptionsTranslatorImpl.translate(Exceptio
nsTranslatorImpl.java:42)
at
me.prettyprint.cassandra.service.KeyspaceServiceImpl$19.execute(KeyspaceServ
iceImpl.java:744)
at
me.prettyprint.cassandra.service.KeyspaceServiceImpl$19.execute(KeyspaceServ
iceImpl.java:726)
at
me.prettyprint.cassandra.service.Operation.executeAndSetResult(Operation.jav
a:101)
at
me.prettyprint.cassandra.connection.HConnectionManager.operateWithFailover(H
ConnectionManager.java:233)
at
me.prettyprint.cassandra.service.KeyspaceServiceImpl.operateWithFailover(Key
spaceServiceImpl.java:131)
at
me.prettyprint.cassandra.service.KeyspaceServiceImpl.getIndexedSlices(Keyspa
ceServiceImpl.java:748)
at
me.prettyprint.cassandra.model.IndexedSlicesQuery$1.doInKeyspace(IndexedSlic
esQuery.java:140)
at
me.prettyprint.cassandra.model.IndexedSlicesQuery$1.doInKeyspace(IndexedSlic
esQuery.java:131)
at
me.prettyprint.cassandra.model.KeyspaceOperationCallback.doInKeyspaceAndMeas
ure(KeyspaceOperationCallback.java:20)
at
me.prettyprint.cassandra.model.ExecutingKeyspace.doExecute(ExecutingKeyspace
.java:85)
at
me.prettyprint.cassandra.model.IndexedSlicesQuery.execute(IndexedSlicesQuery
.java:130)
at
com.lookin2.cassandra.access.CassandraImpl.executeQuery(CassandraImpl.java:2
20)
at
com.lookin2.cassandra.access.CassandraImpl.privateGet(CassandraImpl.java:327
)
at com.lookin2.cassandra.access.Cassandra.get(Cassandra.java:67)
at com.lookin2.cassandra.entities.BaseCass.getRows(BaseCass.java:150)
at com.lookin2.cassandra.entities.CassSet.populateOne(CassSet.java:148)
at com.lookin2.cassandra.entities.CassSet.populate(CassSet.java:117)
at
com.lookin2.cassandra.ontologies.CategoryAccess.getCategories(CategoryAccess
.java:20)
at
com.lookin2.cassandra.ontologies.CategoryOntologyCAO.loadAllNames(CategoryOn
tologyCAO.java:23)
at
com.lookin2.common.dawg.AbstractNamedItemTrie.init(AbstractNamedItemTrie.jav
a:69)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory
.invokeCustomInitMethod(AbstractAutowireCapableBeanFactory.java:1536)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory
.invokeInitMethods(AbstractAutowireCapableBeanFactory.java:1477)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory
.initializeBean(AbstractAutowireCapableBeanFactory.java:1409)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory
.doCreateBean(AbstractAutowireCapableBeanFactory.java:519)
at
org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory
.createBean(AbstractAutowireCapableBeanFactory.java:456)
at
org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(Ab
stractBeanFactory.java:291)
at
org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSi
ngleton(DefaultSingletonBeanRegistry.java:222)
at
org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(Abst
ractBeanFactory.java:288)
at
org.springframework.beans.factory.support.AbstractBeanFactory.getBean(Abstra
ctBeanFactory.java:190)
at
org.springframework.beans.factory.support.DefaultListableBeanFactory.preInst
antiateSingletons(DefaultListableBeanFactory.java:574)
at
org.springframework.context.support.AbstractApplicationContext.finishBeanFac
toryInitialization(AbstractApplicationContext.java:895)
at
org.springframework.context.support.AbstractApplicationContext.refresh(Abstr
actApplicationContext.java:425)
at
org.springframework.web.context.ContextLoader.createWebApplicationContext(Co
ntextLoader.java:276)
at
org.springframework.web.context.ContextLoader.initWebApplicationContext(Cont
extLoader.java:197)
at
org.springframework.web.context.ContextLoaderListener.contextInitialized(Con
textLoaderListener.java:47)
at
org.apache.catalina.core.StandardContext.listenerStart(StandardContext.java:
3972)
at
org.apache.catalina.core.StandardContext.start(StandardContext.java:4467)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
at org.apache.catalina.core.StandardHost.start(StandardHost.java:785)
at org.apache.catalina.core.ContainerBase.start(ContainerBase.java:1045)
at
org.apache.catalina.core.StandardEngine.start(StandardEngine.java:443)
at
org.apache.catalina.core.StandardService.start(StandardService.java:519)
at
org.apache.catalina.core.StandardServer.start(StandardServer.java:710)
at org.apache.catalina.startup.Catalina.start(Catalina.java:581)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39
)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
at org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)
Caused by: TimedOutException()
at
org.apache.cassandra.thrift.Cassandra$get_indexed_slices_result.read(Cassand
ra.java:14073)
at
org.apache.cassandra.thrift.Cassandra$Client.recv_get_indexed_slices(Cassand
ra.java:810)
at
org.apache.cassandra.thrift.Cassandra$Client.get_indexed_slices(Cassandra.ja
va:782)
at
me.prettyprint.cassandra.service.KeyspaceServiceImpl$19.execute(KeyspaceServ
iceImpl.java:732)
... 53 more
-----Original Message-----
From: Sylvain Lebresne [mailto:sylv...@datastax.com]
Sent: Thursday, December 01, 2011 1:38 PM
To: user@cassandra.apache.org
Subject: Re: [RELEASE] Apache Cassandra 1.0.5 released
On Thu, Dec 1, 2011 at 11:58 AM, Michael Vaknine <micha...@citypath.com>
wrote:
> Unfortunately no.
>
> Second time I did the test:
>
> Restore 4 nodes to a new Cassandra cluster (0.7.8)
> Upgrade to 1.0.0
> Run nodetool scrub on each node after upgrade before upgrading next node.
> Upgrade to 1.0.3
> Upgrade to 1.0.5
> Run nodetool repair on all nodes.
> All process was successful.
>
> What does this error means and how is it affecting my cluster?
> Do you think it is safe to upgrade to 1.0.5 and disregard this error?
It's a race condition between the flush of a memtable and the flush of
it's secondary indexes. It's not specific to 1.0.5 at all (it's in 0.8,
probably
since 0.8.0), and it's very unlikely to happen (you're the first to report
it).
The error has not real effect (it cannot result in data corruption or
data loss).
I've created https://issues.apache.org/jira/browse/CASSANDRA-3547
to fix.
--
Sylvain
>
> Thanks
> Michael
>
>
> -----Original Message-----
> From: Jonathan Ellis [mailto:jbel...@gmail.com]
> Sent: Thursday, December 01, 2011 2:10 AM
> To: user@cassandra.apache.org
> Subject: Re: [RELEASE] Apache Cassandra 1.0.5 released
>
> I don't think so. That code hasn't changed in a long time. Is it
> reproducible?
>
> On Wed, Nov 30, 2011 at 2:46 PM, Michael Vaknine <micha...@citypath.com>
> wrote:
>> Hi,
>> Upgrade 1.0.3 to 1.0.5
>> I have this errors
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449
>> AbstractCassandraDaemon.java (line 133) Fatal exception in thread Thread
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449
> java.lang.AssertionError
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.db.ColumnFamilyStore.maybeSwitchMemtable(ColumnFamilySt
>> ore.java:671)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.db.ColumnFamilyStore.forceFlush(ColumnFamilyStore.java:
>> 745)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.db.ColumnFamilyStore.forceBlockingFlush(ColumnFamilySto
>> re.java:750)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.db.index.keys.KeysIndex.forceBlockingFlush(KeysIndex.ja
>> va:119)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.db.index.SecondaryIndexManager.flushIndexesBlocking(Sec
>> ondaryIndexManager.java:258)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.db.index.SecondaryIndexManager.maybeBuildSecondaryIndex
>> es(SecondaryIndexManager.java:123)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.streaming.StreamInSession.closeIfFinished(StreamInSessi
>> on.java:151)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReade
>> r.java:103)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.
>> java:184)
>> TST-Cass2 ERROR [Thread-58] 2011-11-30 20:40:17,449 at
>>
>
org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.jav
>> a:81)
>>
>> Is this another regression?
>>
>> Thanks
>> Michael
>>
>> -----Original Message-----
>> From: Brandon Williams [mailto:dri...@gmail.com]
>> Sent: Wednesday, November 30, 2011 9:43 PM
>> To: user@cassandra.apache.org
>> Subject: Re: [RELEASE] Apache Cassandra 1.0.5 released
>>
>> On Wed, Nov 30, 2011 at 1:29 PM, Michael Vaknine <micha...@citypath.com>
>> wrote:
>>> The files are not on the site
>>> The requested URL
>> /apache//cassandra/1.0.5/apache-cassandra-1.0.5-bin.tar.gz
>>> was not found on this server.
>>
>> It takes the mirrors some time to sync.
>>
>> -Brandon
>>
>
>
>
> --
> Jonathan Ellis
> Project Chair, Apache Cassandra
> co-founder of DataStax, the source for professional Cassandra support
> http://www.datastax.com
>
