[jira] [Created] (HDFS-8332) DistributedFileSystem listCacheDirectives() and listCachePools() API calls should check filesystem closed

2015-05-05 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8332: -- Summary: DistributedFileSystem listCacheDirectives() and listCachePools() API calls should check filesystem closed Key: HDFS-8332 URL: https://issues.apache.org/jira/browse/HDFS-8332

[jira] [Created] (HDFS-8331) Erasure Coding: Create FileStatus isErasureCoded() method

2015-05-05 Thread Rakesh R (JIRA)
Rakesh R created HDFS-8331: -- Summary: Erasure Coding: Create FileStatus isErasureCoded() method Key: HDFS-8331 URL: https://issues.apache.org/jira/browse/HDFS-8331 Project: Hadoop HDFS Issue Type: S

Re: REMINDER! REGISTRATIONS CLOSING 5/6!

2015-05-05 Thread Allen Wittenauer
On May 5, 2015, at 8:10 PM, Allen Wittenauer wrote: > * We’ll be closing registrations to the Bug Bash on May 6th at > 3PM Pacific time. So make sure you do it son: > https://www.eventbrite.com/e/apache-hadoop-global-bug-bash-tickets-16507188445 That should be

[jira] [Created] (HDFS-8330) BlockInfoContiguous in blocksMap can have null BlockCollection

2015-05-05 Thread Chengbing Liu (JIRA)
Chengbing Liu created HDFS-8330: --- Summary: BlockInfoContiguous in blocksMap can have null BlockCollection Key: HDFS-8330 URL: https://issues.apache.org/jira/browse/HDFS-8330 Project: Hadoop HDFS

REMINDER! REGISTRATIONS CLOSING 5/6!

2015-05-05 Thread Allen Wittenauer
Hey gang! A couple of things in regards to the Bug Bash on Friday: * We’ll be closing registrations to the Bug Bash on May 6th at 3PM Pacific time. So make sure you do it son: https://www.eventbrite.com/e/apache-hadoop-global-bug-bash-tickets-165071884

[jira] [Created] (HDFS-8329) Erasure coding: Rename Striped block recovery to reconstruction to eliminate confusion.

2015-05-05 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8329: Summary: Erasure coding: Rename Striped block recovery to reconstruction to eliminate confusion. Key: HDFS-8329 URL: https://issues.apache.org/jira/browse/HDFS-8329 Project: Hadoop H

[jira] [Created] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

2015-05-05 Thread Yi Liu (JIRA)
Yi Liu created HDFS-8328: Summary: Follow-on to update decode for DataNode striped blocks reconstruction Key: HDFS-8328 URL: https://issues.apache.org/jira/browse/HDFS-8328 Project: Hadoop HDFS Issu

Re: Jenkins precommit-*-build

2015-05-05 Thread Colin P. McCabe
Thanks, Allen. This has long been a thorn in our side, and it's really good to see someone work on it. cheers, Colin On Tue, May 5, 2015 at 2:59 PM, Allen Wittenauer wrote: > TL;DR: > > Heads up: I’m going to hack on these scripts to fix the race > conditions. > > > > Pre

Re: Jenkins precommit-*-build

2015-05-05 Thread Allen Wittenauer
HDFS, MAPREDUCE, and YARN have been migrated. Let me know of any issues and I’ll try to get to them as I can. This should be the end of the Jenkins race conditions for our pre commits! *crosses fingers*

[jira] [Created] (HDFS-8327) Compute storage type quotas in INodeFile.computeQuotaDeltaForTruncate()

2015-05-05 Thread Haohui Mai (JIRA)
Haohui Mai created HDFS-8327: Summary: Compute storage type quotas in INodeFile.computeQuotaDeltaForTruncate() Key: HDFS-8327 URL: https://issues.apache.org/jira/browse/HDFS-8327 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-7348) Erasure Coding: DataNode reconstruct striped blocks

2015-05-05 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7348. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed > Erasure Coding: DataNode re

[jira] [Resolved] (HDFS-7672) Erasure Coding: handle write failure for stripping coding blocks

2015-05-05 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze resolved HDFS-7672. --- Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Thanks Ji

Jenkins precommit-*-build

2015-05-05 Thread Allen Wittenauer
TL;DR: Heads up: I’m going to hack on these scripts to fix the race conditions. Presently, we have a pretty wicked race condition in the precommit scripts, namely writing to a directory that is outside of Jenkins' workspace directory. I’ve committed changes this morning

Re: HDFS audit log

2015-05-05 Thread Colin McCabe
I think HDFS INotify is a better choice if you need: * guaranteed backwards compatibility * rapid and unambiguous parsing (via protobuf) * clear Java API for retrieving the data (I.e. not rsync on a text file) * ability to resume reading at a given point if the consumer process fails We are using

Re: fsck output compatibility question with regard to HDFS-7281

2015-05-05 Thread Colin McCabe
How about just having a --json option for the fsck command? That's what we did in Ceph for some command line tools. It would make the output easier to consume and easier to provide compatibility for. Colin On Apr 28, 2015 12:32 PM, "Allen Wittenauer" wrote: > > A lot of the summary information

Re: where is IndexHDFS.java

2015-05-05 Thread Mahmood N
>I don’t think this is from an Apache Project>I'm not aware of any Apache >project with a class named IndexHDFS Not a good news but at least I am now >confident on that. I have to ask some other third party projects that use >hadoop. Thanks, Regards, Mahmood

[jira] [Created] (HDFS-8326) Documentation about when checkpoints are run is out of date

2015-05-05 Thread Misty Stanley-Jones (JIRA)
Misty Stanley-Jones created HDFS-8326: - Summary: Documentation about when checkpoints are run is out of date Key: HDFS-8326 URL: https://issues.apache.org/jira/browse/HDFS-8326 Project: Hadoop HDF

Re: where is IndexHDFS.java

2015-05-05 Thread Chris Nauroth
Hello Mahmood, I'm not aware of any Apache project with a class named IndexHDFS. I just did a scan over my local checkouts of the code for many of the Apache projects, and I didn't find anything. The fact that IndexHDFS is not prefixed with a package name in the stack trace tells me that this is

Jenkins build is back to normal : Hadoop-Hdfs-trunk #2116

2015-05-05 Thread Apache Jenkins Server
See

[jira] [Created] (HDFS-8325) Misspelling of threshold in log4j.properties for tests in hadoop-hdfs

2015-05-05 Thread Brahma Reddy Battula (JIRA)
Brahma Reddy Battula created HDFS-8325: -- Summary: Misspelling of threshold in log4j.properties for tests in hadoop-hdfs Key: HDFS-8325 URL: https://issues.apache.org/jira/browse/HDFS-8325 Project

[jira] [Created] (HDFS-8324) Add trace info to DFSClient#getErasureCodingZoneInfo(..)

2015-05-05 Thread Vinayakumar B (JIRA)
Vinayakumar B created HDFS-8324: --- Summary: Add trace info to DFSClient#getErasureCodingZoneInfo(..) Key: HDFS-8324 URL: https://issues.apache.org/jira/browse/HDFS-8324 Project: Hadoop HDFS Issu

[jira] [Resolved] (HDFS-7688) Client side api/config changes to support online encoding

2015-05-05 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B resolved HDFS-7688. - Resolution: Duplicate > Client side api/config changes to support online encoding > ---

where is IndexHDFS.java

2015-05-05 Thread Mahmood N
Dear Apache Guys, I am trying to run a hadoop/java command which uses a jar file called "IndexData.jar". However, I get an error and the call stack shows Exception in thread "main" java.lang.NullPointerException     at IndexHDFS.indexData(IndexHDFS.java:92)     at IndexHDFS.main(IndexHDFS