>
> /15/06/24 10:35:44 ERROR executor.CoarseGrainedExecutorBackend: Driver
> Disassociated
> [akka.tcp://sparkExecutor@ip-
> ***-**-36-70.us-west-2.compute.internal:59891]
> ->
> [akka.tcp://sparkDriver@ip-***-**-42-150.us-west-2.compute.internal:56572]
> disassociated! Shutting down.
>
then
suddenly crashed with the following 2 lines on executors' logs:
/15/06/24 10:35:44 ERROR executor.CoarseGrainedExecutorBackend: Driver
Disassociated
[akka.tcp://sparkExecutor@ip-***-**-36-70.us-west-2.compute.internal:59891]
->
[akka.tcp://sparkDriver@ip-***-**-42-150.us-west-2.com
;>> seen as FINISHED in the master).
>>>>>
>>>>> There isn't anything wrong in the shell/submit output.
>>>>>
>>>>> When looking at the executor logs, I see logs like this:
>>>>>
>>>>> 15/03/04 21:24:51 INFO
ke this:
>>>>
>>>> 15/03/04 21:24:51 INFO MapOutputTrackerWorker: Doing the fetch; tracker
>>>> actor = Actor[akka.tcp://sparkDriver@ip-10-0-10-17.ec2.internal
>>>> :40019/user/MapOutputTracker#893807065]
>>>> 15/03/04 21:24:51 INFO MapOutputTracke
the executor logs, I see logs like this:
>>>
>>> 15/03/04 21:24:51 INFO MapOutputTrackerWorker: Doing the fetch; tracker
>>> actor = Actor[akka.tcp://sparkDriver@ip-10-0-10-17.ec2.internal
>>> :40019/user/MapOutputTracker#893807065]
>>> 15/03/04 2
Doing the fetch; tracker
>> actor = Actor[akka.tcp://sparkDriver@ip-10-0-10-17.ec2.internal
>> :40019/user/MapOutputTracker#893807065]
>> 15/03/04 21:24:51 INFO MapOutputTrackerWorker: Don't have map outputs for
>> shuffle 38, fetching them
>> 15/03/04
5/03/04 21:24:51 INFO MapOutputTrackerWorker: Don't have map outputs for
> shuffle 38, fetching them
> 15/03/04 21:24:55 ERROR CoarseGrainedExecutorBackend: Driver Disassociated
> [akka.tcp://sparkExecutor@ip-10-0-11-9.ec2.internal:54766] ->
> [akka.tcp://sparkDriver@ip-10-0-10-1
acker
actor = Actor[akka.tcp://sparkDriver@ip-10-0-10-17.ec2.internal
:40019/user/MapOutputTracker#893807065]
15/03/04 21:24:51 INFO MapOutputTrackerWorker: Don't have map outputs for
shuffle 38, fetching them
15/03/04 21:24:55 ERROR CoarseGrainedExecutorBackend: Driver Disassociated
ka.dispatch.Mailbox.run(Mailbox.scala:218)
> at
> akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:386)
> at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
> at
> scala.concurrent.forkjoin.ForkJoi
I got this error from the executor's stderr:
[akka.tcp://sparkDriver@saturn00:49464] disassociated! Shutting down. What is
the reason of "Actor not found"?
// Yoonmin Nam
-
To unsubscribe, e-mail: user-unsubscr...@spark
ster node: pzxnvm2018.x.y.org
>> worker nodes: pzxnvm2022.x.y.org pzxnvm2023.x.y.org pzxnvm2024.x.y.org
>>
>>
>> From: ilike...@gmail.com
>> Date: Tue, 8 Jul 2014 11:59:54 -0700
>>
>> Subject: Re: CoarseGrainedExecutorBackend: Driver Disassociated
>> To: us
g pzxnvm2024.x.y.org
>
>
> From: ilike...@gmail.com
> Date: Tue, 8 Jul 2014 11:59:54 -0700
>
> Subject: Re: CoarseGrainedExecutorBackend: Driver Disassociated
> To: user@spark.apache.org
>
>
> Hmm, looks like the Executor is trying to connect to the driver on
>
: pzxnvm2018.x.y.orgworker nodes: pzxnvm2022.x.y.org
pzxnvm2023.x.y.org pzxnvm2024.x.y.org
From: ilike...@gmail.com
Date: Tue, 8 Jul 2014 11:59:54 -0700
Subject: Re: CoarseGrainedExecutorBackend: Driver Disassociated
To: user@spark.apache.org
Hmm, looks like the Executor is trying to connect to the
martphone
Original message From: Aaron Davidson
Date:07/08/2014 12:00 PM (GMT-08:00)
To: user@spark.apache.org Subject: Re:
CoarseGrainedExecutorBackend: Driver Disassociated
Hmm, looks like the Executor is trying to connect to the driver on
localhost, from this line:
14/07/08 11:0
: Connecting to worker akka.tcp://
> sparkwor...@pzxnvm2022.x.y.name.org:37054/user/Worker
> 14/07/08 11:07:13 ERROR CoarseGrainedExecutorBackend: Driver Disassociated
> [akka.tcp://sparkexecu...@pzxnvm2022.dcld.pldc.kp.org:34679] -> [akka
>
>
> I am not sure what the problem is but it is preventing me to get the 4
> node test cluster up and running.
>
>
/user/CoarseGrainedScheduler14/07/08 11:07:13
INFO WorkerWatcher: Connecting to worker
akka.tcp://sparkwor...@pzxnvm2022.x.y.name.org:37054/user/Worker14/07/08
11:07:13 ERROR CoarseGrainedExecutorBackend: Driver Disassociated
[akka.tcp://sparkexecu...@pzxnvm2022.dcld.pldc.kp.org:34679] -> [ak
16 matches
Mail list logo