Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1270

2016-05-25 Thread Apache Jenkins Server
See Changes: [Carlo Curino] YARN-4957. Add getNewReservation in ApplicationClientProtocol (Sean Po -- [...truncated 5257 lines...] Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time

Hadoop-Hdfs-trunk-Java8 - Build # 1270 - Still Failing

2016-05-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1270/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5454 lines...] [INFO] [INFO] --- maven-enforcer-pl

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1269

2016-05-25 Thread Apache Jenkins Server
See Changes: [aw] HADOOP-12925. Checks for SPARC architecture need to include 64-bit SPARC -- [...truncated 6707 lines...] at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProt

Hadoop-Hdfs-trunk-Java8 - Build # 1269 - Failure

2016-05-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1269/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6904 lines...] [INFO] [INFO] --- maven-enforcer-pl

[jira] [Resolved] (HDFS-10444) Refactor tests by moving irrevelant parts out of TestAsyncDFSRename

2016-05-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou resolved HDFS-10444. -- Resolution: Duplicate Mark this as duplicate since it's been addressed in HDFS-10431. > Refacto

Jenkins build is back to normal : Hadoop-Hdfs-trunk-Java8 #1268

2016-05-25 Thread Apache Jenkins Server
See - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

[jira] [Created] (HDFS-10466) DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation

2016-05-25 Thread Juan Yu (JIRA)
Juan Yu created HDFS-10466: -- Summary: DistributedFileSystem.listLocatedStatus() should return HdfsBlockLocation instead of BlockLocation Key: HDFS-10466 URL: https://issues.apache.org/jira/browse/HDFS-10466

[jira] [Created] (HDFS-10464) libhdfs++: Implement GetPathInfo

2016-05-25 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-10464: - Summary: libhdfs++: Implement GetPathInfo Key: HDFS-10464 URL: https://issues.apache.org/jira/browse/HDFS-10464 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-10465) libhdfs++: Implement ListDirectory

2016-05-25 Thread Bob Hansen (JIRA)
Bob Hansen created HDFS-10465: - Summary: libhdfs++: Implement ListDirectory Key: HDFS-10465 URL: https://issues.apache.org/jira/browse/HDFS-10465 Project: Hadoop HDFS Issue Type: Sub-task

Hadoop-Hdfs-trunk-Java8 - Build # 1267 - Still Failing

2016-05-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1267/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5432 lines...] [INFO] --- maven-source-plugin:2.3:j

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1267

2016-05-25 Thread Apache Jenkins Server
See Changes: [kai.zheng] HADOOP-12579. Deprecate and remove WriteableRPCEngine. Contributed by -- [...truncated 5235 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elap

[jira] [Created] (HDFS-10463) TestRollingFileSystemSinkWithHdfs needs some cleanup

2016-05-25 Thread Daniel Templeton (JIRA)
Daniel Templeton created HDFS-10463: --- Summary: TestRollingFileSystemSinkWithHdfs needs some cleanup Key: HDFS-10463 URL: https://issues.apache.org/jira/browse/HDFS-10463 Project: Hadoop HDFS

[jira] [Created] (HDFS-10462) Authenticate to Azure Data Lake using client ID and keys

2016-05-25 Thread Atul Sikaria (JIRA)
Atul Sikaria created HDFS-10462: --- Summary: Authenticate to Azure Data Lake using client ID and keys Key: HDFS-10462 URL: https://issues.apache.org/jira/browse/HDFS-10462 Project: Hadoop HDFS Is

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1266

2016-05-25 Thread Apache Jenkins Server
See Changes: [rkanter] YARN-4766. NM should not aggregate logs older than the retention policy [kasha] YARN-3344. Fix warning - procfs stat file is not in the expected format. -- [...tr

Hadoop-Hdfs-trunk-Java8 - Build # 1266 - Failure

2016-05-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1266/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 5436 lines...] [INFO] [INFO] --- maven-enforcer-pl

Re: Cp command is not atomic

2016-05-25 Thread Kun Ren
Thanks a lot, Chris, this is helpful. On Wed, May 25, 2016 at 12:33 PM, Chris Nauroth wrote: > Hello Kun, > > You are correct that "hdfs dfs -cp" is not atomic, but the details of that > are a bit different from what you described. For the example you gave, > the sequence of events would be: >

[jira] [Created] (HDFS-10461) Erasure Coding: Optimize block checksum recalculation logic on the fly by reconstructing multiple missed blocks at a time

2016-05-25 Thread Rakesh R (JIRA)
Rakesh R created HDFS-10461: --- Summary: Erasure Coding: Optimize block checksum recalculation logic on the fly by reconstructing multiple missed blocks at a time Key: HDFS-10461 URL: https://issues.apache.org/jira/browse

[jira] [Created] (HDFS-10460) Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block

2016-05-25 Thread Rakesh R (JIRA)
Rakesh R created HDFS-10460: --- Summary: Erasure Coding: Recompute block checksum for a particular range less than file size on the fly by reconstructing missed block Key: HDFS-10460 URL: https://issues.apache.org/jira/br

Re: Cp command is not atomic

2016-05-25 Thread Chris Nauroth
Hello Kun, You are correct that "hdfs dfs -cp" is not atomic, but the details of that are a bit different from what you described. For the example you gave, the sequence of events would be: 1. Open a.xml. 2. Create file b.xml._COPYING_. 3. Copy the bytes from a.xml to b.xml._COPYING_. 4. Rename

Re: HDFS Federation-- cross namenodes operations

2016-05-25 Thread Chris Nauroth
Hello Kun, I replied to this same question on the user@ list. For usage questions like this, the user@ list is the correct forum. It's not necessary to cross-post to the dev@ lists. --Chris Nauroth On 5/25/16, 8:58 AM, "Kun Ren" wrote: >Hi Genius, > >Does HDFS Federation support the cross

HDFS Federation-- cross namenodes operations

2016-05-25 Thread Kun Ren
Hi Genius, Does HDFS Federation support the cross namenodes operations? For example: ./bin/hdfs dfs -cp input1/a.xml input2/b.xml Supposed that input1 belongs namenode 1, and input 2 belongs namenode 2, does Federation support this operation? And if not, why? Thanks.

[jira] [Created] (HDFS-10459) getTurnOffTip computes needed block incorrectly for threshold = 1

2016-05-25 Thread Eric Badger (JIRA)
Eric Badger created HDFS-10459: -- Summary: getTurnOffTip computes needed block incorrectly for threshold = 1 Key: HDFS-10459 URL: https://issues.apache.org/jira/browse/HDFS-10459 Project: Hadoop HDFS

Cp command is not atomic

2016-05-25 Thread Kun Ren
Hi Genius, If I understand correctly, the shell command "cp" for the HDFS is not atomic, is that correct? For example: ./bin/hdfs dfs -cp input/a.xml input/b.xml This command actually does 3 things, 1. read input/a.xml; 2. Create a new file input/b.xml; 3. Write the content of a.xml to b.xml;

Jenkins build is back to normal : Hadoop-Hdfs-trunk-Java8 #1264

2016-05-25 Thread Apache Jenkins Server
See - To unsubscribe, e-mail: hdfs-dev-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-dev-h...@hadoop.apache.org

Hadoop-Hdfs-trunk-Java8 - Build # 1263 - Still Failing

2016-05-25 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/1263/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 53690 lines...] [INFO] [INFO] --- maven-enforcer-p

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #1263

2016-05-25 Thread Apache Jenkins Server
See Changes: [vinayakumarb] HDFS-10217. show 'blockScheduled' tooltip in datanodes table. -- [...truncated 53493 lines...] Running org.apache.hadoop.hdfs.TestSetTimes Tests run: 8, Failur