That's what resource managers provide to you. So you can code and deal with
resource managers, but I assume you're finding ways to not deal with
resource managers directly and let Spark do it instead.
I admit I have no experience (I did the similar with Apache Storm on
standalone setup 5+ years ag
Can I cut a steak with a hammer? Sure you can, but the steak would taste awful
Do you have organizational/bureaucratic issues with using a Load Balancer?
Because that’s what you really need. Run your application on multiple nodes
with a load balancer in front. When a node crashes, the load balan