Re: running a Spark fat jar in Zeppelin

2018-04-12 Thread Jeff Zhang
No, you can not do that in zeppelin. In that case, you may try apache livy's batch mode to submit your spark app jar https://livy.incubator.apache.org/ Soheil Pourbafrani 于2018年4月12日周四 下午12:57写道: > Hi, Is it possible, instead of codding Spark in Zeppelin environment, run > a fat jar file int

SPARK_SUBMIT_OPTIONS variable didin't applied!

2018-04-12 Thread Soheil Pourbafrani
I use SPARK_SUBMIT_OPTIONS variable in zeppeline-env.sh file to set some options for spark applications that runs for zeppelin. export SPARK_SUBMIT_OPTIONS="--executor-memory 512m --driver-memory 512m --executor-cores 2 --queue onlineQ" But running spark on the Yarn cluster, it didn't applied. Wh

Re: SPARK_SUBMIT_OPTIONS variable didin't applied!

2018-04-12 Thread Jeff Zhang
you can set spark.yarn.queue in interpreter setting Soheil Pourbafrani 于2018年4月12日周四 下午6:00写道: > I use SPARK_SUBMIT_OPTIONS variable in zeppeline-env.sh file to set some > options for spark applications that runs for zeppelin. > > export SPARK_SUBMIT_OPTIONS="--executor-memory 512m --driver-mem

Unsubscribe

2018-04-12 Thread Richard A. Bross
- Original Message - From: "Soheil Pourbafrani" To: users@zeppelin.apache.org Sent: Thursday, April 12, 2018 5:59:28 AM Subject: SPARK_SUBMIT_OPTIONS variable didin't applied! I use SPARK_SUBMIT_OPTIONS variable in zeppeline-env.sh file to set some options for spark applications that