Hi Ozone community, Now that 2.0 release work is underway, I'd like to take this opportunity to discuss future roadmaps, namely Ozone 2.1 and 3.0. Let's find out what could be accomplished within the next quarter or two. I'd be happy to RM 2.1 to keep the momentum going.
A number of interesting features that folks kept talking about: * Trino support HDDS-12289 <https://issues.apache.org/jira/browse/HDDS-12289> * HBase support (GA) * Multiple data center support HDDS-6818 <https://issues.apache.org/jira/browse/HDDS-6818> * Realtime Cross-Region Bucket Replication HDDS-12307 <https://issues.apache.org/jira/browse/HDDS-12307> * Short Circuit Read HDDS-10685 <https://issues.apache.org/jira/browse/HDDS-10685> * Storage Container Reconciliation HDDS-10239 <https://issues.apache.org/jira/browse/HDDS-10239> * AWS S3 Lifecycle Configurations - Object Expire HDDS-8342 <https://issues.apache.org/jira/browse/HDDS-8342> (and overall, full S3 support) * Ozone Streaming * Migrating Ozone Manager replication from post Ratis execution to Pre Ratis execution. HDDS-11897 <https://issues.apache.org/jira/browse/HDDS-11897> For Ozone 3.0, we should look at road maps about 2-3 years out. I'd like to propose to use Ozone 3.0 to modernize our dependencies that are long overdue: - Drop JDK 8. (Drop JDK 11 too and move to JDK17?) - Drop Hadoop 2 - Migrate Jetty from 9 to 12. - Migrate RocksDB from 7 to 9. - Migrate to Protobuf 3 Let me know if I missed anything! --- For reference, here's a (incomplete) list of features in Ozone 2.0: HDDS-8829 Symmetric Keys for Delegation Tokens HDDS-7852 SCM Decommissioning Support HDDS-7593 Supporting HSync and lease recovery HDDS-10656 Atomic Key Overwrite and Key Replacement HDDS-8246 Java 11/17/21 Support and Testing HDDS-7593 Supporting HSync and lease recovery Notable improvements in Ozone 2.0: HDDS-8544 <https://issues.apache.org/jira/browse/HDDS-8544> Snapshot feature Phase 2 : Further enhancements for Ozone Snapshots HDDS-11506 <https://issues.apache.org/jira/browse/HDDS-11506> Improvements for large scale deletion Other notable changes in Ozone 2.0: 1. Hadoop dependency was updated to 3.4.1 2. Dropped Hadoop 2.7 ~ 2.9 support. Only 2.10.1 is supported 3. HDDS-11759 Remove LegacyReplicationManager 4. HDDS-11753 Deprecate file per chunk layout from datanode code 5. HDDS-7307 Move S3 Gateway web admin to separate port 6. AWS SDK v2 client support 1. Both v1 and v2 are supported now. 7. JDK17 support HDDS-8247 <https://issues.apache.org/jira/browse/HDDS-8247> 8. ARM64 support 9. JUnit 4 to 5 upgrade 10. HDDS-11754 <https://issues.apache.org/jira/browse/HDDS-11754> Drop support for non-Ratis OM and SCM