Re: Multiple spark shell sessions

2014-10-01 Thread Sanjay Subramanian
: Error was: Failure(java.net.BindException: Address already in use)14/10/01 17:34:38 INFO SparkUI: Started SparkUI at http://hadoop02:4041 sanjay From: Matei Zaharia To: Sanjay Subramanian Cc: "user@spark.apache.org" Sent: Wednesday, October 1, 2014 5:19 PM Subject: Re: Mult

Re: Multiple spark shell sessions

2014-10-01 Thread Matei Zaharia
You need to set --total-executor-cores to limit how many total cores it grabs on the cluster. --executor-cores is just for each individual executor, but it will try to launch many of them. Matei On Oct 1, 2014, at 4:29 PM, Sanjay Subramanian wrote: > hey guys > > I am using spark 1.0.0+cdh

Multiple spark shell sessions

2014-10-01 Thread Sanjay Subramanian
hey guys I am usingĀ  spark 1.0.0+cdh5.1.0+41 When two users try to run "spark-shell" , the first guy's spark-shell shows active in the 18080 Web UI but the second user shows WAITING and the shell has a bunch of errors but does go the spark-shell and "sc.master" seems to point to the correct master

Re: Multiple spark shell sessions

2014-09-05 Thread Andrew Ash
i also > received another port for UI application. > > Thanks, > Dhimant > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Multiple-spark-shell-sessions-tp13441p13459.html > Sent from the Apache Spark User

Re: Multiple spark shell sessions

2014-09-04 Thread Dhimant
Thanks Yana, I am able to execute application and command via another session, i also received another port for UI application. Thanks, Dhimant -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Multiple-spark-shell-sessions-tp13441p13459.html Sent from the

Re: Multiple spark shell sessions

2014-09-04 Thread Yana Kadiyska
at > > scala.tools.nsc.util.ScalaClassLoader$.savingContextLoader(ScalaClassLoader.scala:135) > at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:884) > at org.apache.spark.repl.SparkILoop.process(SparkILoop.scala:982) > at org

Multiple spark shell sessions

2014-09-04 Thread Dhimant
la:55) at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) / -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Multiple-spark-shell-sessions-tp13441.html Sent from the Apache Spark User List mailing list archive at Nabbl