?Thanks for update, John. Then we should be OK with fixing this issue in 2.8.1.
Mark the target version of HADOOP-14205 to 2.8.1 instead of 2.8.0 and bump up
to blocker in case we could miss this in releasing 2.8.1. :)
Thanks,
Junping
________________________________
From: John Zhuge <jzh...@cloudera.com>
Sent: Monday, March 20, 2017 10:31 AM
To: Junping Du
Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
Yes, it only affects ADL. There is a workaround of adding these 2 properties to
core-site.xml:
<property>
<name>fs.adl.impl</name>
<value>org.apache.hadoop.fs.adl.AdlFileSystem</value>
</property>
<property>
<name>fs.AbstractFileSystem.adl.impl</name>
<value>org.apache.hadoop.fs.adl.Adl</value>
</property>
I have the initial patch ready but hitting these live unit test failures:
Failed tests:
TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.testListStatus:257
expected:<1> but was:<10>
Tests in error:
TestAdlFileContextMainOperationsLive>FileContextMainOperationsBaseTest.testMkdirsFailsForSubdirectoryOfExistingFile:254
» AccessControl
TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.testMkdirsFailsForSubdirectoryOfExistingFile:190
» AccessControl
Stay tuned...
John Zhuge
Software Engineer, Cloudera
On Mon, Mar 20, 2017 at 10:02 AM, Junping Du
<j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote:
Thank you for reporting the issue, John! Does this issue only affect ADL (Azure
Data Lake) which is a new feature for 2.8 rather than other existing FS? If so,
I think we can leave the fix to 2.8.1 to fix given this is not a regression and
just a new feature get broken.?
Thanks,
Junping
________________________________
From: John Zhuge <jzh...@cloudera.com<mailto:jzh...@cloudera.com>>
Sent: Monday, March 20, 2017 9:07 AM
To: Junping Du
Cc: common-dev@hadoop.apache.org<mailto:common-dev@hadoop.apache.org>;
hdfs-...@hadoop.apache.org<mailto:hdfs-...@hadoop.apache.org>;
yarn-...@hadoop.apache.org<mailto:yarn-...@hadoop.apache.org>;
mapreduce-...@hadoop.apache.org<mailto:mapreduce-...@hadoop.apache.org>
Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
Discovered https://issues.apache.org/jira/browse/HADOOP-14205 "No FileSystem
for scheme: adl".
The issue were caused by backporting HADOOP-13037 to branch-2 and earlier.
HADOOP-12666 should not be backported, but some changes are needed: property
fs.adl.impl in core-default.xml and hadoop-tools-dist/pom.xml.
I am working on a patch.
John Zhuge
Software Engineer, Cloudera
On Fri, Mar 17, 2017 at 2:18 AM, Junping Du
<j...@hortonworks.com<mailto:j...@hortonworks.com>> wrote:
Hi all,
With fix of HDFS-11431 get in, I've created a new release candidate (RC3)
for Apache Hadoop 2.8.0.
This is the next minor release to follow up 2.7.0 which has been released
for more than 1 year. It comprises 2,900+ fixes, improvements, and new
features. Most of these commits are released for the first time in branch-2.
More information about the 2.8.0 release plan can be found here:
https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+2.8+Release
New RC is available at:
http://home.apache.org/~junping_du/hadoop-2.8.0-RC3
The RC tag in git is: release-2.8.0-RC3, and the latest commit id is:
91f2b7a13d1e97be65db92ddabc627cc29ac0009
The maven artifacts are available via
repository.apache.org<http://repository.apache.org> at:
https://repository.apache.org/content/repositories/orgapachehadoop-1057
Please try the release and vote; the vote will run for the usual 5 days,
ending on 03/22/2017 PDT time.
Thanks,
Junping
