Hi, I have a spark cluster that has 5 machines with 32 GB memory each and 2 machines with 24 GB each.
I believe the spark.executor.memory will assign the executor memory for all executors. How can I use 32 GB memory from the first 5 machines and 24 GB from the next 2 machines. Thanks ..Manas