Hi all, I’d like to start a discussion on *FLIP-XXX: Enhancing HistoryServer with Lazy Loading and Pluggable Storage*.
This FLIP proposes improving the HistoryServer to address *slow startup*, *delayed job visibility*, and *excessive small files* when handling large numbers of archived jobs. The proposal introduces: - *Lazy loading mode* for on-demand job archive fetching - Optional *RocksDB-based storage* to reduce small files Compatibility: Full backward compatibility (EAGER + FILE as default) The detailed designs are described in the FLIP document: https://docs.google.com/document/d/1FQn-HQSIdhio3ImeOrbS9VfB6JqRTrRV4ZEZDTf3K2o/edit?usp=sharing Looking forward to your feedback. Best regards, Zihao Chen
