[
https://issues.apache.org/jira/browse/HDDS-17510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Siyao Meng updated HDDS-17510:
------------------------------
Description:
{code}
Executing test ozonesecure-ha/test-ranger.sh
Downloading /tmp/apache-ranger-2.9.0.tar.gz from
https://www.apache.org/dyn/closer.lua?action=download&filename=ranger/2.9.0/apache-ranger-2.9.0.tar.gz
Downloading /tmp/ranger-2.9.0-ozone-plugin.tar.gz from
https://www.apache.org/dyn/closer.lua?action=download&filename=ranger/2.9.0/plugins/ozone/ranger-2.9.0-ozone-plugin.tar.gz
curl: (22) The requested URL returned error: 503
tar (child): /tmp/ranger-2.9.0-ozone-plugin.tar.gz: Cannot open: No such file
or directory
ERROR: Test execution of ozonesecure-ha/test-ranger.sh is FAILED!!!!
{code}
h3. Root cause
{{download_if_not_exists}} in {{compose/testlib.sh}} runs {{curl}} without
{{--retry}}, so a single transient 503 from the Apache mirror redirector
({{closer.lua}}) leaves the Ranger plugin tarball missing and
{{test-ranger.sh}} fails before the cluster starts. The same URL downloaded
fine seconds later for {{test-sts.sh}} in the same job.
h3. Fix
Add {{--retry 3}} to the {{curl}} call, which retries transient HTTP errors
(408, 429, 5xx) and timeouts with exponential backoff.
Also cache the release tarballs downloaded by the {{ranger}} and {{s3a}}
acceptance suites with {{actions/cache}}, keyed on the suite and the Hadoop and
Ranger versions in the root {{pom.xml}}, so they are downloaded only after a
version bump.
- https://github.com/apache/ozone/actions/runs/40556333377/job/122394762302
- https://github.com/apache/ozone/actions/runs/40398232788/job/121844345255
was:
{code}
Executing test ozonesecure-ha/test-ranger.sh
Downloading /tmp/apache-ranger-2.9.0.tar.gz from
https://www.apache.org/dyn/closer.lua?action=download&filename=ranger/2.9.0/apache-ranger-2.9.0.tar.gz
Downloading /tmp/ranger-2.9.0-ozone-plugin.tar.gz from
https://www.apache.org/dyn/closer.lua?action=download&filename=ranger/2.9.0/plugins/ozone/ranger-2.9.0-ozone-plugin.tar.gz
curl: (22) The requested URL returned error: 503
tar (child): /tmp/ranger-2.9.0-ozone-plugin.tar.gz: Cannot open: No such file
or directory
ERROR: Test execution of ozonesecure-ha/test-ranger.sh is FAILED!!!!
{code}
h3. Root cause
{{download_if_not_exists}} in {{compose/testlib.sh}} runs {{curl}} without
{{--retry}}, so a single transient 503 from the Apache mirror redirector
({{closer.lua}}) leaves the Ranger plugin tarball missing and
{{test-ranger.sh}} fails before the cluster starts. The same URL downloaded
fine seconds later for {{test-sts.sh}} in the same job.
h3. Fix
Add {{--retry 3}} to the {{curl}} call, which retries transient HTTP errors
(408, 429, 5xx) and timeouts with exponential backoff.
- https://github.com/apache/ozone/actions/runs/40556333377/job/122394762302
- https://github.com/apache/ozone/actions/runs/40398232788/job/121844345255
> Intermittent failure in ozonesecure-ha/test-ranger.sh when Ranger download
> returns 503
> --------------------------------------------------------------------------------------
>
> Key: HDDS-17510
> URL: https://issues.apache.org/jira/browse/HDDS-17510
> Project: Apache Ozone
> Issue Type: Sub-task
> Components: test
> Reporter: Siyao Meng
> Assignee: Siyao Meng
> Priority: Major
> Labels: pull-request-available
>
> {code}
> Executing test ozonesecure-ha/test-ranger.sh
> Downloading /tmp/apache-ranger-2.9.0.tar.gz from
> https://www.apache.org/dyn/closer.lua?action=download&filename=ranger/2.9.0/apache-ranger-2.9.0.tar.gz
> Downloading /tmp/ranger-2.9.0-ozone-plugin.tar.gz from
> https://www.apache.org/dyn/closer.lua?action=download&filename=ranger/2.9.0/plugins/ozone/ranger-2.9.0-ozone-plugin.tar.gz
> curl: (22) The requested URL returned error: 503
> tar (child): /tmp/ranger-2.9.0-ozone-plugin.tar.gz: Cannot open: No such file
> or directory
> ERROR: Test execution of ozonesecure-ha/test-ranger.sh is FAILED!!!!
> {code}
> h3. Root cause
> {{download_if_not_exists}} in {{compose/testlib.sh}} runs {{curl}} without
> {{--retry}}, so a single transient 503 from the Apache mirror redirector
> ({{closer.lua}}) leaves the Ranger plugin tarball missing and
> {{test-ranger.sh}} fails before the cluster starts. The same URL downloaded
> fine seconds later for {{test-sts.sh}} in the same job.
> h3. Fix
> Add {{--retry 3}} to the {{curl}} call, which retries transient HTTP errors
> (408, 429, 5xx) and timeouts with exponential backoff.
> Also cache the release tarballs downloaded by the {{ranger}} and {{s3a}}
> acceptance suites with {{actions/cache}}, keyed on the suite and the Hadoop
> and Ranger versions in the root {{pom.xml}}, so they are downloaded only
> after a version bump.
> - https://github.com/apache/ozone/actions/runs/40556333377/job/122394762302
> - https://github.com/apache/ozone/actions/runs/40398232788/job/121844345255
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
