Hi, Recently I've configured spark in cluster with zookeper. I have 2 masters ( active/standby) and 6 workers. I've begun my installation with samples from example directory. Everything worked fine when I only used memory . When I used word count example I got messages like the ones below:
14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError [akka.tcp:// sparkwor...@spark-slave1.domain.org:7078] -> [akka.tcp:// sparkexecu...@spark-slave1.domain.org:53757]: Error [Association failed with [akka.tcp://sparkexecu...@spark-slave1.domain.org:53757]] [ akka.remote.EndpointAssociationException: Association failed with [akka.tcp://sparkexecu...@spark-slave1.domain.org:53757] Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: spark-slave1.domain.org/10.0.6.228:53757 ] 14/10/09 19:37:19 ERROR remote.EndpointWriter: AssociationError [akka.tcp:// sparkwor...@spark-slave1.domain.org:7078] -> [akka.tcp:// sparkexecu...@spark-slave1.domain.org:53757]: Error [Association failed with [akka.tcp://sparkexecu...@spark-slave1.domain.org:53757]] [ akka.remote.EndpointAssociationException: Association failed with [akka.tcp://sparkexecu...@spark-slave1.domain.org:53757] Caused by: akka.remote.transport.netty.NettyTransport$$anonfun$associate$1$$anon$2: Connection refused: spark-slave1.domain.org/10.0.6.228:53757 ] I'm a little confused because I can't find any solution to my problem. I use Cloudera hadoop with spark. Best regards, Morbious
