Do getExecutorStorageStatus and getExecutorMemoryStatus both return the number of executors + the driver? E.g., if I submit a job with 10 executors, I get 11 for getExeuctorStorageStatus.length and getExecutorMemoryStatus.size
On Thu, Jul 24, 2014 at 4:53 PM, Nicolas Mai <nicolas....@gmail.com> wrote: > Thanks, this is what I needed :) I should have searched more... > > Something I noticed though: after the SparkContext is initialized, I had to > wait for a few seconds until sc.getExecutorStorageStatus.length returns the > correct number of workers in my cluster (otherwise it returns 1, for the > driver)... > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Getting-the-number-of-slaves-tp10604p10619.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >
