Hi all, I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver stability for large applications"
The goal of the SPIP is to improve the Driver's stability by supporting storing Spark's UI data on RocksDB. Furthermore, to fasten the read and write operations on RocksDB, it introduces a new Protobuf serializer. Please also refer to the following: - Previous discussion in the dev mailing list: [DISCUSS] SPIP: Better Spark UI scalability and Driver stability for large applications <https://lists.apache.org/thread/f30owdts644hk2oojyf9jr308mrx2m9l> - Design Doc: Better Spark UI scalability and Driver stability for large applications <https://docs.google.com/document/d/1cuKnFwlTodyVhUQPMuakq2YDaLH05jaY9FRu_aD1zMo/edit?usp=sharing> - JIRA: SPARK-41053 <https://issues.apache.org/jira/browse/SPARK-41053> Please vote on the SPIP for the next 72 hours: [ ] +1: Accept the proposal as an official SPIP [ ] +0 [ ] -1: I don’t think this is a good idea because … Kind Regards, Gengliang
