Hi,
I meet the same problem in the context of spark and yarn.
When I open pyspark with the following command:
spark/bin/pyspark --master yarn-client --num-executors 1 --executor-memory
2500m
It turns out *INFO storage.BlockManagerMasterActor: Registering block
manager ip-10-0-6-171.us-west-2.
Hey Larry,
I have been trying to figure this out for standalone clusters as well.
http://apache-spark-user-list.1001560.n3.nabble.com/What-is-a-Block-Manager-td12833.html
has an answer as to what block manager is for.
>From the documentation, what I understood was if you assign X GB to each
execu
