Re: num-executors, executor-memory and executor-cores parameters

2016-08-04 Thread Mich Talebzadeh
This is A classic minefield of different explanation. Here we go this is mine. Local mode In this mode the driver program (SparkSubmit), the resource manager and executor all exist within the same JVM. The JVM itself is the worker thread. All local mode jobs run independently. There is no resourc

num-executors, executor-memory and executor-cores parameters

2016-08-04 Thread Ashok Kumar
Hi I would like to know the exact definition for these three  parameters  num-executors executor-memory executor-cores for local, standalone and yarn modes I have looked at on-line doc but not convinced if I understand them correct. Thanking you