Thank you for bringing this up and sorry for the late response. As you mentioned, I think that YARN federation is way more stable and complete after all this work. We should close a couple more open JIRAs but after that I think we should start targeting a 3.4 release. There are a more big features like the compilation for Windows that Gautham has been driving.
Thank you for the work! On Fri, Aug 18, 2023 at 4:16 AM slfan1989 <slfan1...@apache.org> wrote: > Dear Hadoop Community: > > I am Shilun Fan, and I would like to extend my heartfelt gratitude to > Inigo Goiri for invaluable assistance. With the support of Inigo, we have > been able to collaboratively improve the Hadoop Yarn Federation module, > contributing more than 150 PRs to enhance this module. > We have decided to release a new version in October of this year, which > will include the enhanced features of the Hadoop Yarn Federation. > > The new version of YARN Federation will include the following enhancements: > > 1. YARN Router now offers a full implementation of all relevant > interfaces, including ApplicationClientProtocol, > ResourceManagerAdministrationProtocol, and RMWebServiceProtocol. > 2. Enhanced support for Application cleanup and automatic offline > mechanisms for SubCluster are now facilitated by the YARN Router. > 3. Code optimization for Router and AMRMProxy was undertaken, coupled with > improvements to previously pending functionalities. > 4. Audit logs and Metrics for Router have been updated. > 5. A boost in cluster security features was achieved, with the inclusion > of Kerberos support. > 6. The page function of the router has been improved. > 7. Introduce a dedicated set of commands to manage SubCluster and > FederationQueuePolicies. > > In addition, the version to be released in October will also include > DataNode fine-grained global lock and HDFS EC stability features, which > will be released by Xiaoqiao He. > > Once again, I want to extend my sincere thanks to Inigo and Xiaoqiao for > their tremendous assistance. > > Warm regards, > Shilun Fan >
