Re: Set numExecutors by sparklaunch

2015-10-22 Thread Luc Bourlier
Hi, I don't know much about you particular use case, but most (if not all) of the Spark command line parameters can also be specified as properties. You should try to use SparkLauncher.setConf("spark.executor.instances", "3") HTH, Luc Luc Bourlier *Spark Team - Typesafe, Inc.* luc.bourl...@typ

Set numExecutors by sparklaunch

2015-10-20 Thread qinggangwa...@gmail.com
Hi all, I want to launch spark job on yarn by java, but it seemes that there is no way to set numExecutors int the class SparkLauncher. Is there any way to set numExecutors ?Thanks qinggangwa...@gmail.com