[jira] [Created] (HDFS-5106) TestDatanodeBlockScanner fails on Windows due to incorrect path format

Chuan Liu created HDFS-5106: --- Summary: TestDatanodeBlockScanner fails on Windows due to incorrect path format Key: HDFS-5106 URL: https://issues.apache.org/jira/browse/HDFS-5106 Project: Hadoop HDFS

[jira] [Created] (HDFS-5105) TestFsck fails on Windows

Chuan Liu created HDFS-5105: --- Summary: TestFsck fails on Windows Key: HDFS-5105 URL: https://issues.apache.org/jira/browse/HDFS-5105 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 3.0.0

Re: [ACTION NEEDED]: protoc 2.5.0 in trunk/branch-2/branch-2.1-beta/branch-2.1.0-beta

Thanks for sharing! We also need to update Wiki or some documents, don't we? http://wiki.apache.org/hadoop/HowToContribute On Thu, Aug 15, 2013 at 8:03 AM, Alejandro Abdelnur wrote: > Following up on this. > > HADOOP-9845 & HADOOP-9872 have been committed > to trunk/branch-2/branch-2.1-beta/branc

[VOTE] Release Apache Hadoop 2.0.6-alpha (RC1)

All, I have created a release candidate (rc1) for hadoop-2.0.6-alpha that I would like to release. This is a stabilization release that includes fixed for a couple a of issues as outlined on the security list. The RC is available at: http://people.apache.org/~cos/hadoop-2.0.6-alpha-rc1/ The RC t

Re: [VOTE] Release Apache Hadoop 2.0.6-alpha

Sure Alejandro, not a big deal - I agree. Uploaded RC1 and restartig the vote right away. Thanks for catching this! Cos On Thu, Aug 15, 2013 at 09:08PM, Alejandro Abdelnur wrote: > it should be straight forward adding the license headers to the release > notes. please make sure apache-rat:check p

Re: [VOTE] Release Apache Hadoop 2.0.6-alpha

it should be straight forward adding the license headers to the release notes. please make sure apache-rat:check passes on the RC before publishing it. Arun, as you are about to cut the new RC for 2.1.0-beta, can you please make sure the license headers are used in the releasenotes HTML files? Th

Re: [VOTE] Release Apache Hadoop 2.0.6-alpha

Alejandro, looking into the source code: it seems that release notes never had license boilerplate in it, hence 2.0.6-alpha doesn't have as well. I have fixed CHANGES with new optimistic date of the release and upload rc1 right now. Please let me know if you feel like we need start doing the lic

[jira] [Created] (HDFS-5104) Support dotdot name in NFS LOOKUP operation

Brandon Li created HDFS-5104: Summary: Support dotdot name in NFS LOOKUP operation Key: HDFS-5104 URL: https://issues.apache.org/jira/browse/HDFS-5104 Project: Hadoop HDFS Issue Type: Sub-task

Re: [VOTE] Release Apache Hadoop 2.0.6-alpha

Darn CHANGES - apparently they just hate me. I agree that needs to be addressed. I will spin-up rc1 tonight and restart the vote. Thanks, Cos On Wed, Aug 14, 2013 at 10:40AM, Alejandro Abdelnur wrote: > OK: > * verified MD5 > * verified signature > * expanded source tar and did a build > * conf

[jira] [Created] (HDFS-5103) TestDirectoryScanner fails on Windows

Chuan Liu created HDFS-5103: --- Summary: TestDirectoryScanner fails on Windows Key: HDFS-5103 URL: https://issues.apache.org/jira/browse/HDFS-5103 Project: Hadoop HDFS Issue Type: Bug Affects Ver

[jira] [Created] (HDFS-5102) Snapshot names should not be allowed to contain slash characters

Aaron T. Myers created HDFS-5102: Summary: Snapshot names should not be allowed to contain slash characters Key: HDFS-5102 URL: https://issues.apache.org/jira/browse/HDFS-5102 Project: Hadoop HDFS

Re: Secure deletion of blocks

Hi Matt, I'd also recommend implementing this in a somewhat pluggable way -- eg a configuration for a Deleter class. The default Deleter can be the one we use today which just removes the file, and you could plug in a SecureDeleter. I'd also see some use cases for a Deleter implementation which do

[VOTE] Release Apache Hadoop 2.1.0-beta

Folks, I've created a release candidate (rc2) for hadoop-2.1.0-beta that I would like to get released - this fixes the bugs we saw since the last go-around (rc1). The RC is available at: http://people.apache.org/~acmurthy/hadoop-2.1.0-beta-rc2/ The RC tag in svn is here: http://svn.apache.org/

[jira] [Created] (HDFS-5101) ZCR should work with blocks bigger than 2 GB

Colin Patrick McCabe created HDFS-5101: -- Summary: ZCR should work with blocks bigger than 2 GB Key: HDFS-5101 URL: https://issues.apache.org/jira/browse/HDFS-5101 Project: Hadoop HDFS Is

[jira] [Resolved] (HDFS-2984) S-live: Rate operation count for delete is worse than 0.20.204 by 28.8%

[ https://issues.apache.org/jira/browse/HDFS-2984?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash resolved HDFS-2984. Resolution: Cannot Reproduce > S-live: Rate operation count for delete is worse than 0.20.204 by

Re: Secure deletion of blocks

Hi Matt, Here are some code pointers: - When doing a file deletion, the NameNode turns the file into a set of blocks that need to be deleted. - When datanodes heartbeat in to the NN (see BPServiceActor#offerService), the NN replies with blocks to be invalidated (see BlockCommand and DatanodeProto

mapred replication

In debugging some replication issues in our HDFS environment, I noticed that the MapReduce framework uses the following algorithm for setting the replication on submitted job files: 1. Create the file with *default* DFS replication factor (i.e. 'dfs.replication') 2. Subsequently alter

Hadoop-Hdfs-trunk - Build # 1492 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1492/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 11769 lines...] [INFO] --- maven-source-plugin:2.1.2:jar-

Build failed in Jenkins: Hadoop-Hdfs-trunk #1492

See Changes: [sseth] YARN-1045. Improve toString implementation for PBImpls. Contributed by Jian He. [cnauroth] HDFS-4632. globStatus using backslash for escaping does not work on Windows. Contributed by Chuan Liu. [szetszwo] HDFS

Secure deletion of blocks

Hi, I'm looking into writing a patch for HDFS which will provide a new method within HDFS which can securely delete the contents of a block on all the nodes upon which it exists. By securely delete I mean, overwrite with 1's/0's/random data cyclically such that the data could not be recovered foren

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #700

See Changes: [jlowe] svn merge -c 1513888 FIXES: YARN-337. RM handles killed application tracking URL poorly. Contributed by Jason Lowe -- [...truncated 7673 lines...] [ERROR] location: pa

Hadoop-Hdfs-0.23-Build - Build # 700 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/700/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7866 lines...] [ERROR] /home/jenkins/jenkins-slave/w