[
https://issues.apache.org/jira/browse/HDDS-16137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18129380#comment-18129380
]
Siyao Meng commented on HDDS-16137:
-----------------------------------
Attached HDDS-16137.001.patch: bumps {{hadoop.version}} from 3.4.3 to 3.4.4. It
is only for use once Hadoop 3.4.4 is released with the IPv6 backports. Ratis
needs no change: master is on 3.3.1, which includes RATIS-2592.
I checked it against smengcl/hadoop {{branch-3.4.4}} (0ac75945), built as
3.4.4-SNAPSHOT. That branch carries HADOOP-19958, HADOOP-19960, HADOOP-20020,
HADOOP-19961, HADOOP-19962 and HADOOP-20019. In main code each one is identical
to its trunk commit. Ozone master plus the open HDDS-17135, HDDS-17138 and
HDDS-17195 changes compiles against it (55 modules).
h3. IPv6 checks through Ozone code paths
|| Check || 3.4.3 || 3.4.4 ||
| OM token service from {{OMProxyInfo}}, round trip and
{{OzoneDelegationTokenSelector}}, {{use_ip=true}} | fail
({{2001:db8:0:0:0:0:0:10:9862}}) | pass ({{[2001:db8:0:0:0:0:0:10]:9862}}) |
| Same with {{use_ip=false}} | fail (OM address left unresolved) | pass |
| {{NetUtils.createSocketAddr("[v6]:port")}} with {{use_ip=false}} | fail
(unresolved) | pass |
| {{MachineList}} with {{2001:db8::/32}} | fail (cannot parse) | pass |
| {{KMSUtil.createKeyProviderFromUri}}, single host and percent-encoded
multi-host IPv6 | fail (cannot parse port) | pass |
| {{_HOST}} with {{::}} / {{[::]}} | fail ({{om/::@REALM}}) | pass |
| {{DNS.reverseDns}} for IPv6 | fail ({{ArrayIndexOutOfBoundsException}}) |
pass (queries {{ip6.arpa}}) |
h3. Regression run on 3.4.4
98 test classes in 13 modules (token, security, KMS, DNS, address helpers, HTTP
servers, ACLs and the HDDS-15763 IPv6 tests): 859 tests, 2 failures. Both
failures also occur on 3.4.3 and come from running as root
({{TestServerUtils#testSetDataDirectoryPermissionsSkipsReadOnlyDir}},
{{TestOmUtils#createOMDirThrowsIfCannotCreate}}).
h3. Not covered
* No end-to-end IPv6 run: the environment had IPv6 disabled in the kernel
({{ipv6.disable=1}}).
* The fixes have fixVersion 3.6.0 only and are not yet on Apache {{branch-3.4}}.
> Consume Hadoop and Ratis releases required for Ozone IPv6 support
> -----------------------------------------------------------------
>
> Key: HDDS-16137
> URL: https://issues.apache.org/jira/browse/HDDS-16137
> Project: Apache Ozone
> Issue Type: Task
> Reporter: Siyao Meng
> Priority: Major
> Attachments: HDDS-16137.001.patch
>
>
> Ozone IPv6 support depends on fixes that must be present in released Hadoop
> and Ratis artifacts. Code on development branches or resolved Jira status is
> not sufficient.
> Select and consume the first dependency releases containing:
> * HADOOP-19958: IPv6 delegation-token service addresses
> * HADOOP-19960: IPv6 reverse DNS
> * HADOOP-19961: IPv6 KMS provider authorities
> * HADOOP-19962: IPv6 CIDR rules in MachineList
> * HADOOP-20019: IPv6 wildcard address in Kerberos {{_HOST}} substitution
> * HADOOP-20020: DNS.reverseDns NullPointerException on an answer without a
> PTR record
> * RATIS-2592: IPv6-safe Ratis CLI peer parsing
> Update the Ozone dependency versions and run the applicable IPv4, dual-stack,
> secure IPv6-only, HA, KMS, delegation-token, authorization, and migration
> tests. Record the first dependency versions supported by Ozone.
> Parent epic: HDDS-15763.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
