Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/483/ [Aug 2, 2017 7:03:25 AM] (jianhe) YARN-6872. [Addendum patch] Ensure apps could run given NodeLabels are [Aug 2, 2017 11:48:06 AM] (stevel) HADOOP-14709. Fix checkstyle warnings in ContractTestUtils. Contr

[jira] [Created] (HDFS-12266) Ozone : add debug cli to hdfs script

Chen Liang created HDFS-12266: - Summary: Ozone : add debug cli to hdfs script Key: HDFS-12266 URL: https://issues.apache.org/jira/browse/HDFS-12266 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-12265) Ozone : better handling of operation fail due to chill mode

Chen Liang created HDFS-12265: - Summary: Ozone : better handling of operation fail due to chill mode Key: HDFS-12265 URL: https://issues.apache.org/jira/browse/HDFS-12265 Project: Hadoop HDFS Is

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (binding) Looked through the src tarball. Checksum and signature match, skimmed NOTICE/LICENSE, ran some unit tests. -C On Sat, Jul 29, 2017 at 4:29 PM, Konstantin Shvachko wrote: > Hi everybody, > > Here is the next release of Apache Hadoop 2.7 line. The previous stable > release 2.7.3 was a

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Forgot to mention, also did Namenode performance testing using Dynamometer (see http://mail-archives.apache.org/mod_mbox/hadoop-common-dev/201707.mbox/%3CCAGkyFnM7Ltpb-C_rxP43VUguRXb1bvxPH7GMqdSweE2iJx7i%2Bg%40mail.gmail.com%3E). Reran production traces from multi-thousand node clusters and did n

[jira] [Created] (HDFS-12264) DataNode uses a deprecated method IoUtils#cleanup.

Ajay Yadav created HDFS-12264: - Summary: DataNode uses a deprecated method IoUtils#cleanup. Key: HDFS-12264 URL: https://issues.apache.org/jira/browse/HDFS-12264 Project: Hadoop HDFS Issue Type:

[jira] [Created] (HDFS-12263) Revise StreamCapacities doc to describe the API usage and the requirements for customized OutputStream implemetation

Lei (Eddy) Xu created HDFS-12263: Summary: Revise StreamCapacities doc to describe the API usage and the requirements for customized OutputStream implemetation Key: HDFS-12263 URL: https://issues.apache.org/jira/b

[jira] [Created] (HDFS-12262) Ozone: KSM: Reduce default handler thread count from 200

Xiaoyu Yao created HDFS-12262: - Summary: Ozone: KSM: Reduce default handler thread count from 200 Key: HDFS-12262 URL: https://issues.apache.org/jira/browse/HDFS-12262 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

+1 (non-binding) - Verified checksum and signature of source and binary tarballs - Built from source, macOS Sierra 10.12.3 and RHEL 6.6, Oracle JDK 1.8.0_72 - Ran basic HDFS commands and some MR example jobs (using 2.7.4 client) against a 2.6.1 cluster - Started MiniCluster, ran basic HDFS comman

Re: How to restore data from HDFS rm -skipTrash

If you stopped the cluster immediately you may have a chance to restore most of the data. It's a manual and hacky process. You can use the Offline Edits Viewer to see the latest edits and cut off the delete transactions that was issues by mistake. Then you can restart the namenode with the modifies

[jira] [Created] (HDFS-12261) Improve HdfsAdmin's javadoc regarding superusers.

Xiao Chen created HDFS-12261: Summary: Improve HdfsAdmin's javadoc regarding superusers. Key: HDFS-12261 URL: https://issues.apache.org/jira/browse/HDFS-12261 Project: Hadoop HDFS Issue Type: Imp

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Wei-Chi, There is bunch of performance jiras in Hadoop. This one is not marked as blocker and seems to be hard to reproduce. And I see that you are still discussing the problem and the solution with Daryn in the jira. I don't think it should block the release. If this or anything else will prov

[jira] [Created] (HDFS-12260) StreamCapabilities.StreamCapability should be public.

Lei (Eddy) Xu created HDFS-12260: Summary: StreamCapabilities.StreamCapability should be public. Key: HDFS-12260 URL: https://issues.apache.org/jira/browse/HDFS-12260 Project: Hadoop HDFS Iss

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi, I'm sorry coming to this vote late. Daryn mentioned in HDFS-12136 that HDFS-11160 has a performance regression at DataNode due to the way it locks dataset lock. HDFS-11160 is in Hadoop 2.7.4.

Re: How to restore data from HDFS rm -skipTrash

Panfei > we stop the namenode and datanodes This is also really hacky, but if all else fails... It still may be too late, but if you are only running one datanode, you could look at your hdfs-site.xml, find the property named "dfs.data.dir", and go to that directory. Look around under there and s

Re: How to restore data from HDFS rm -skipTrash

If the directory has snapshot enabled, the file can be retrieved from the past snapshots. Otherwise, the file inodes are removed from namenode metadata, and blocks are scheduled for deletion. You might want to play with edit log a bit. Remove the delete entries from edit logs. But it's hacky and d

Re: Fwd: How to restore data from HDFS rm -skipTrash

Hi Basically it deletes metadata. If you have backup from metadata you maybe can restore. Br, Margus Margus (margusja) Roo http://margus.roo.ee skype: margusja https://www.facebook.com/allan.tuuring +372 51 48 780 On 04/08/2017 06:38, panfei wrote: I want to know is there any way to stop th

[jira] [Created] (HDFS-12259) Ozone: OzoneClient: Refactor ozone client code and move it from hadoop-hdfs to hadoop-hdfs-client project

Nandakumar created HDFS-12259: - Summary: Ozone: OzoneClient: Refactor ozone client code and move it from hadoop-hdfs to hadoop-hdfs-client project Key: HDFS-12259 URL: https://issues.apache.org/jira/browse/HDFS-12259