Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Xiao Chen
+1 (non-binding) Thanks Andrew for putting this up! Super excited to see a Hadoop 3 RC. Verifications done on OS X: - Verified md5 on all files - Spot checked release notes and changes - Built from source - Verified LICENSE and NOTICE are correctly contained in the jars built - Started pseudo-dis

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Rakesh Radhakrishnan
Thanks for getting this out. +1 (non-binding) - downloaded and built tarball from source - deployed HDFS-HA cluster and tested few EC file operations - executed few hdfs commands including EC commands - viewed basic UI - ran some of the sample jobs Best Regards, Rakesh Intel On Thu, Sep 1, 201

[jira] [Created] (HDFS-10825) Snapshot read can reveal future bytes if snapshotted while writing

2016-08-31 Thread Abhishek Rai (JIRA)
Abhishek Rai created HDFS-10825: --- Summary: Snapshot read can reveal future bytes if snapshotted while writing Key: HDFS-10825 URL: https://issues.apache.org/jira/browse/HDFS-10825 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread John Zhuge
+1 (non-binding) - Build source with Java 1.8.0_101 on Centos 6.6 without native - Verify license and notice using the shell script in HADOOP-13374 - Deploy a pseudo cluster - Run basic dfs, distcp, ACL, webhdfs commands - Run MapReduce workcount and pi examples - Run balancer Thanks, John John

[jira] [Reopened] (HDFS-10662) Optimize UTF8 string/byte conversions

2016-08-31 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang reopened HDFS-10662: -- Sorry to reopen the JIRA. I'm backporting to branch-2.7 and it was quite messy. [~daryn] [~kihwal] I'd appr

[jira] [Created] (HDFS-10824) MiniDFSCluster#storageCapacities has no effects on real capacity

2016-08-31 Thread Xiaobing Zhou (JIRA)
Xiaobing Zhou created HDFS-10824: Summary: MiniDFSCluster#storageCapacities has no effects on real capacity Key: HDFS-10824 URL: https://issues.apache.org/jira/browse/HDFS-10824 Project: Hadoop HDFS

[jira] [Created] (HDFS-10823) Implement HttpFSFileSystem#listStatusIterator

2016-08-31 Thread Andrew Wang (JIRA)
Andrew Wang created HDFS-10823: -- Summary: Implement HttpFSFileSystem#listStatusIterator Key: HDFS-10823 URL: https://issues.apache.org/jira/browse/HDFS-10823 Project: Hadoop HDFS Issue Type: Imp

[jira] [Created] (HDFS-10822) Log DataNodes in the write pipeline

2016-08-31 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10822: - Summary: Log DataNodes in the write pipeline Key: HDFS-10822 URL: https://issues.apache.org/jira/browse/HDFS-10822 Project: Hadoop HDFS Issue Type: Improvement

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Gangumalla, Uma
+1 (binding). Overall it¹s a great effort, Andrew. Thank you for putting all the energy. Downloaded and built. Ran some sample jobs. I would love to see all this efforts will lead to get the GA from Hadoop 3.X soon. Regards, Uma On 8/30/16, 8:51 AM, "Andrew Wang" wrote: >Hi all, > >Thanks t

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Aaron T. Myers
+1 (binding) from me. Downloaded the source, built from source, set up a pseudo cluster, and ran a few of the sample jobs. Thanks a lot for doing all this release work, Andrew. -- Aaron T. Myers Software Engineer, Cloudera On Tue, Aug 30, 2016 at 8:51 AM, Andrew Wang wrote: > Hi all, > > Thank

[DISCUSS] HADOOP-13341 Merge Request

2016-08-31 Thread Allen Wittenauer
Before requesting a merge vote, I'd like for folks to take a look at HADOOP-13341. This branch changes how the vast majority of the _OPTS variables work in various ways, making things easier for devs and users by helping to make the rules consistent. It also clarifies/cleans up how the _USER

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread Sean Busbey
It's also the key Andrew has in the project's KEYS file: http://www.apache.org/dist/hadoop/common/KEYS On Tue, Aug 30, 2016 at 4:12 PM, Andrew Wang wrote: > Hi Eric, thanks for trying this out, > > I tried this gpg command to get my key, seemed to work: > > # gpg --keyserver pgp.mit.edu --recv

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

2016-08-31 Thread Apache Jenkins Server
For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/150/ [Aug 30, 2016 1:59:57 PM] (jlowe) MAPREDUCE-4784. TestRecovery occasionally fails. Contributed by Haibo [Aug 30, 2016 5:43:20 PM] (weichiu) HDFS-10760. DataXceiver#run() should not log InvalidToken excepti

Re: Why do sequential block IDs begin from 2^30?

2016-08-31 Thread Arpit Agarwal
Hi Ewan, It’s not the low 30 bits that are reserved. Just the first 2^30 block IDs. Block IDs are longs so we are unlikely to ever run out. The choice was arbitrary and not based on likelihood of collision with earlier block IDs. On 8/25/16, 2:38 AM, "Ewan Higgs" wrote: Hi all, I s

[jira] [Created] (HDFS-10821) DiskBalancer: Report command support with multiple nodes

2016-08-31 Thread Yiqun Lin (JIRA)
Yiqun Lin created HDFS-10821: Summary: DiskBalancer: Report command support with multiple nodes Key: HDFS-10821 URL: https://issues.apache.org/jira/browse/HDFS-10821 Project: Hadoop HDFS Issue Ty