Hello,
I am doing some performance testing on Spark and
1. I would like to verify Spark's parallelism, empirically. For example, I
would like to determine if the number of "performance-heavy" threads is
equal to SPARK_WORKER_CORES in standalone mode at a given moment.
Essentially, I want to ensu
I am running a very simple program (WordCount) on Spark stand-alone mode. I
find that when I examine the
web UI, a couple bugs arise:
1. There is a discrepancy between the number denoting the duration of the
application when I run the history server and the number given by the web UI
(default addr
