Well there has been more bug fixes added to RC3 as well. So its best to try out the current master and let us know whether you still get the scary logs.
TD On Sun, May 4, 2014 at 3:52 AM, wxhsdp <wxh...@gmail.com> wrote: > Hi, TD > > actually, i'am not very clear with my spark version. i check out from > https://github.com/apache/spark/trunk on Apr 30. > > please tell me from where do you get the version Spark 1.0 RC3 > > i do not call sparkContext.stop. now i add it to the end of my code > > here's the log > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/metrics/json,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/stages/stage/kill,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/static,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/executors/json,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/executors,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/environment/json,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/environment,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/storage/rdd/json,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/storage/rdd,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/storage/json,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/storage,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/stages/pool/json,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/stages/pool,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/stages/stage/json,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/stages/stage,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/stages/json,null} > 14/05/04 18:48:21 INFO handler.ContextHandler: stopped > o.e.j.s.ServletContextHandler{/stages,null} > 14/05/04 18:48:21 INFO ui.SparkUI: Stopped Spark web UI at > http://ubuntu.local:4040 > 14/05/04 18:48:21 INFO scheduler.DAGScheduler: Stopping DAGScheduler > 14/05/04 18:48:22 INFO spark.MapOutputTrackerMasterActor: > MapOutputTrackerActor stopped! > 14/05/04 18:48:23 INFO network.ConnectionManager: Selector thread was > interrupted! > 14/05/04 18:48:23 INFO network.ConnectionManager: ConnectionManager stopped > 14/05/04 18:48:23 INFO storage.MemoryStore: MemoryStore cleared > 14/05/04 18:48:23 INFO storage.BlockManager: BlockManager stopped > 14/05/04 18:48:23 INFO storage.BlockManagerMasterActor: Stopping > BlockManagerMaster > 14/05/04 18:48:23 INFO storage.BlockManagerMaster: BlockManagerMaster > stopped > 14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator: > Shutting down remote daemon. > 14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator: > Remote daemon shut down; proceeding with flushing remote transports. > 14/05/04 18:48:23 INFO spark.SparkContext: Successfully stopped > SparkContext > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #3 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #1 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #2 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #3 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #1 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #2 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #6 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #4 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #5 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #6 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #4 > 14/05/04 18:48:23 ERROR nio.AbstractNioSelector: Interrupted while wait for > resources to be released #5 > 14/05/04 18:48:23 INFO Remoting: Remoting shut down > 14/05/04 18:48:23 INFO remote.RemoteActorRefProvider$RemotingTerminator: > Remoting shut down. > > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/sbt-run-with-spark-ContextCleaner-ERROR-tp5304p5309.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
