Re: Submit job with driver options in Mesos Cluster mode

2016-10-31 Thread Michael Gummelt
TOR_OPTS -> -Dspark.executor.extraJavaOptions=-Dloglevel=DEBUG > ... > > Any help would be great. I know that we can set some "spark.*" settings in > default configs, but these are not necessarily spark related. This is not > an > issue when

Re: Submit job with driver options in Mesos Cluster mode

2016-10-27 Thread Rodrick Brown
se are not necessarily spark related. This is not an > issue when running the same logic outside of a Mesos cluster in Spark > standalone mode. > > Thanks! > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Submi

Re: Submit job with driver options in Mesos Cluster mode

2016-10-27 Thread vonnagy
be used. The problem for us, is that these extra Java options are not the same for each job that is submitted and thus can't put the values in spark-defaults.conf. Ivan -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Submit-job-with-driver-options-in-

Re: Submit job with driver options in Mesos Cluster mode

2016-10-27 Thread csakoda
ge in context: http://apache-spark-user-list.1001560.n3.nabble.com/Submit-job-with-driver-options-in-Mesos-Cluster-mode-tp27853p27972.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e

Submit job with driver options in Mesos Cluster mode

2016-10-06 Thread vonnagy
ks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Submit-job-with-driver-options-in-Mesos-Cluster-mode-tp27853.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe e-mail: user-unsubscr...@spark.apache.org