Re: network.ConnectionManager error

2014-09-17 Thread Reynold Xin
This is during shutdown right? Looks ok to me since connections are being closed. We could've handle this more gracefully, but the logs look harmless. On Wednesday, September 17, 2014, wyphao.2007 wrote: > Hi, When I run spark job on yarn,and the job finished success,but I found > there are som

Re: network.ConnectionManager error

2014-09-17 Thread Christian Chua
I see the same thing. A workaround is to put a Thread.sleep(5000) statement before sc.stop() Let us know how it goes. > On Sep 17, 2014, at 3:43 AM, "wyphao.2007" wrote: > > Hi, When I run spark job on yarn,and the job finished success,but I found > there are some error logs in the logfi

network.ConnectionManager error

2014-09-17 Thread wyphao.2007
Hi, When I run spark job on yarn,and the job finished success,but I found there are some error logs in the logfile as follow(the red color text): 14/09/17 18:25:03 INFO ui.SparkUI: Stopped Spark web UI at http://sparkserver2.cn:63937 14/09/17 18:25:03 INFO scheduler.DAGScheduler: Stopping DAGS