I am not sure why Spark web UI keeps changing its port every time I restart a cluster? how can I make it run always on one port? I did make sure there is no process running on 4040(spark default web ui port) however it still starts at 8080. any ideas?
MasterWebUI: Bound MasterWebUI to 0.0.0.0, and started at http://x.x.x.x:8080 Thanks!