,
> > >
> > >
> > > Junping
> > >
> > > ________________
> > > From: John Zhuge
> > > Sent: Monday, March 20, 2017 10:31 AM
> > > To: Junping Du
> > > Cc: common-dev@hadoop.apache
; > Sent: Monday, March 20, 2017 10:31 AM
> > To: Junping Du
> > Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
> > yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
> > Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
> >
> > Ye
, John Zhuge
> > >> wrote:
> > >>>
> > >>>> Yes, it only affects ADL. There is a workaround of adding these 2
> > >>>> properties to core-site.xml:
> > >>>>
> > >>>>
> > >>>> fs.
>> please keep on verification work and report any issues if founded - I
> >> will
> >>> check if another round of RC is needed based on your findings. Thanks!
> >>>
> >>>
> >>> Thanks,
> >>>
> >>>
> >>> Ju
e will close the vote in next 24 hours. For people who haven't vote,
>>> please keep on verification work and report any issues if founded - I
>> will
>>> check if another round of RC is needed based on your findings. Thanks!
>>>
>>>
>>> Thanks,
>>>
>>>
>&g
rectoryOfExistingFile:254
> > > » AccessControl
> > >
> > > TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.
> > > testMkdirsFailsForSubdirectoryOfExistingFile:190
> > > » AccessControl
> > >
> > >
> > >
n your findings. Thanks!
>
>
> Thanks,
>
>
> Junping
>
>
>
> From: Kuhu Shukla
> Sent: Tuesday, March 21, 2017 3:17 PM
> Cc: Junping Du; common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org; mapreduce-...@hado
org;
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
+1 (non-binding)
- Verified signatures.
- Downloaded and built from source tar.gz.
- Deployed a pseudo-distributed cluster on Mac Sierra.
- Ran example Sleep job successfully.
- Deployed latest
>>
>> John Zhuge
>> Software Engineer, Cloudera
>>
>> On Mon, Mar 20, 2017 at 10:02 AM, Junping Du wrote:
>>
>>> Thank you for reporting the issue, John! Does this issue only affect ADL
>>> (Azure Data Lake) which is a new feature for 2.8 rather than othe
, I think we can leave the fix to 2.8.1 to fix given this is
> not a
> > regression and just a new feature get broken.
> >
> >
> > Thanks,
> >
> >
> > Junping
> > --
> > *From:* John Zhuge
> > *Sent:* Monday, March 20, 20
ken.
> >
> >
> > Thanks,
> >
> >
> > Junping
> > --
> > *From:* John Zhuge
> > *Sent:* Monday, March 20, 2017 9:07 AM
> > *To:* Junping Du
> > *Cc:* common-dev@hadoop.apache.org; hdfs-...@hadoop.apache
> On Mar 21, 2017, at 10:12 AM, Andrew Wang wrote:
>
> I poked around a bit. The 3.0.0-alpha2 binary tarball is only 246M and has
> more changes than 2.8.0.
Not to disclaim any other potential issues, but it's worth noting 3.x de-dupes
jar files as part of the packaging process. So it's not
in releasing 2.8.1. :)
> >>
> >>
> >> Thanks,
> >>
> >>
> >> Junping
> >>
> >>
> >> From: John Zhuge
> >> Sent: Monday, March 20, 2017 10:31 AM
&
ression and just a new feature get broken.
> >
> >
> > Thanks,
> >
> >
> > Junping
> > --
> > *From:* John Zhuge
> > *Sent:* Monday, March 20, 2017 9:07 AM
> > *To:* Junping Du
> > *Cc:* common-dev@hadoop
s in releasing 2.8.1. :)
>>
>>
>> Thanks,
>>
>>
>> Junping
>>
>>
>> From: John Zhuge
>> Sent: Monday, March 20, 2017 10:31 AM
>> To: Junping Du
>> Cc: common-dev@hadoop.apache.org; hd
gt;
>
> From: John Zhuge mailto:jzh...@cloudera.com>>
> Sent: Monday, March 20, 2017 9:07 AM
> To: Junping Du
> Cc: common-dev@hadoop.apache.org<mailto:common-dev@hadoop.apache.org>;
> hdfs-...@hadoop.apache.org<mailto:hdfs-...@hadoop.apach
I poked around a bit. The 3.0.0-alpha2 binary tarball is only 246M and has
more changes than 2.8.0.
It looks like the 2.8.0 bin tarball has an extra 1.5GB of docs when
extracted compared to 3.0.0-alpha2. I think it's from the extra src-html
content:
-> % find share/doc -name src-html | xargs du -
Thanks Junping for taking on this huge effort!
I found one tiny nit: the md5 files are not in conventional format
That is to say,
$ cat hadoop-2.8.0.tar.gz.md5
$ /usr/bin/md5sum /build/source/target/artifacts/hadoop-2.8.0.tar.gz
c728a090b68d009070085367695ed507
/build/source/target/artifacts/
Thanks Junping!
+1 (binding)
* Verified signatures and checksums
* Built Hive 2.1.0 and Tez 0.8.5 with Hadoop 2.8.0 pom
* Deployed a single node cluster and ran some Hive on Tez queries
successfully
* The document looks good.
I found a trivial issue in the doc. It does not block the release.
Thanks for putting this up, Junping.
+1(non-binding)
* verified signature and mds.
* built from source on centos 7 and openjdk 8 with native profile.
* built docs and skimmed the contents.
* deployed 3 nodes ha cluster and run some sample jobs with caller
context enabled.
Masatake Iwasaki
On
Hi,
I have used release package and verified basic operations for HDFS.
I raised one blocker issue for this release.
HADOOP-14207 : "dfsadmin -refreshCallQueue" command is failing with
DecayRpcScheduler
Thanks,
Surendra
-Original Message-
From: Ju
Hi Junping,
Thank you for working on this.
+1 (Non-Binding)
verified the following:
1. Deployed HA cluster with three Nodes.
2. Verified the basic shell operations
3. Ran wordount and pi jobs
Regards
Brahma Reddy Battula
-Original Message-
From: Junping Du [mailto:j...@hortonworks.com]
: Monday, March 20, 2017 10:31 AM
To: Junping Du
Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
Yes, it only affects ADL. There is a workaround of adding these 2
> Thanks,
>
>
> Junping
>
>
> From: John Zhuge
> Sent: Monday, March 20, 2017 9:07 AM
> To: Junping Du
> Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
> yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
> Subject: Re: [V
From: John Zhuge
Sent: Monday, March 20, 2017 9:07 AM
To: Junping Du
Cc: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Subject: Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)
Discovered https
Discovered https://issues.apache.org/jira/browse/HADOOP-14205 "No
FileSystem for scheme: adl".
The issue were caused by backporting HADOOP-13037 to branch-2 and earlier.
HADOOP-12666 should not be backported, but some changes are needed:
property fs.adl.impl in core-default.xml and hadoop-tools-di
+1 (non-binding)
Tested from the released binary package
* 5 node cluster running from dockerized containers (every
namenode/datanode/nodemanager, etc. are running in separated containers)
* Bitcoin bockchain data (~100Gb) parsed and imported to HBase (1.2.4)
* Spark (2.1.0 with included hadoop)
On 19 Mar 2017, at 15:23, Steve Loughran
mailto:ste...@hortonworks.com>> wrote:
Thanks, testing in progress
here's the windows native binaries to go with it, all signed
https://github.com/steveloughran/winutils/releases/tag/hadoop-2.8.0-RC3
The gnu shell commands which came with git worked w
+1 (non-binding). Thanks Junping for the effort.
I have used release package and verified below cases
- Ran MR sleep job and wordcount successfully in where nodes are configured
with labels.
- Verified application priority feature and I could see high priority apps
are getting resource over lower
Thanks, testing in progress
here's the windows native binaries to go with it, all signed
https://github.com/steveloughran/winutils/releases/tag/hadoop-2.8.0-RC3
The gnu shell commands which came with git worked well here, and the build went
through fast, nice to see
Test results to follow
O
+1 (binding)
- Verfied signatures and digests- Performed a native build from the release
tag- Deployed to a single node cluster- Ran some sample jobs
Jason
On Friday, March 17, 2017 4:18 AM, Junping Du wrote:
Hi all,
With fix of HDFS-11431 get in, I've created a new release candida
Thanks Junping for doing this.
+1 (non-binding)
0. Download the src tar.gz file; checked the MD5 checksum
1. Build Hadoop from source successfully
2. Deploy a single node cluster and start the cluster successfully
3. Operate the HDFS from command line: ls, put, distcp, dfsadmin etc
4. Run hadoop
Thanks for the new RC, Junping. I built from source and tried it out on
a 2-node cluster with HA enabled. I ran a pi job and some streaming
jobs. I tested that localization and failover work correctly, and I
played a little with the YARN and HDFS web UIs.
I did encounter an old friend of mi
+1
Thanks, Junping, for your efforts to get this release out.
I downloaded and built the source, and i did the following manual testing on a
2-node pseudo cluster:
- Streaming job
- Inter-queue (cross-queue) preemption--verified that only the expected amount
of preemptions occured.
- Inter-queue
34 matches
Mail list logo
