Dear Hadoop Community: I am Shilun Fan, and I would like to extend my heartfelt gratitude to Inigo Goiri for invaluable assistance. With the support of Inigo, we have been able to collaboratively improve the Hadoop Yarn Federation module, contributing more than 150 PRs to enhance this module. We have decided to release a new version in October of this year, which will include the enhanced features of the Hadoop Yarn Federation.
The new version of YARN Federation will include the following enhancements: 1. YARN Router now offers a full implementation of all relevant interfaces, including ApplicationClientProtocol, ResourceManagerAdministrationProtocol, and RMWebServiceProtocol. 2. Enhanced support for Application cleanup and automatic offline mechanisms for SubCluster are now facilitated by the YARN Router. 3. Code optimization for Router and AMRMProxy was undertaken, coupled with improvements to previously pending functionalities. 4. Audit logs and Metrics for Router have been updated. 5. A boost in cluster security features was achieved, with the inclusion of Kerberos support. 6. The page function of the router has been improved. 7. Introduce a dedicated set of commands to manage SubCluster and FederationQueuePolicies. In addition, the version to be released in October will also include DataNode fine-grained global lock and HDFS EC stability features, which will be released by Xiaoqiao He. Once again, I want to extend my sincere thanks to Inigo and Xiaoqiao for their tremendous assistance. Warm regards, Shilun Fan
