Hi, We created the custom spark application and executing it via spark submit. When the job is executed via command line, it completes in 9-10 mins however when I am trying to execute the spark submit command via shell script it takes long time to execute (~40-50 mins).
The command present in the shell script is identical what we executed via command line. Below is the command: spark-submit --class "<class-name>" --master yarn --driver-memory 15G --num-executors 150 --executor-memory 25G <path-to-jar>/<jar-name>.jar <path-to-properties-file>/<properties-file-name>.properties Kindly suggest. Note- Spark version- 1.5 Thanks, Saurabh
