DistributedFileSystem.listStatus() - Why does it do partial listings then assemble?

Could someone explain why the DistributedFileSystem's listStatus() method does a piecemeal assembly of a directory listing within the method? Is there a locking issue? What if an element is added to the the directory during the operation?  What if elements are removed? It would make sense to me

Package Dependancy Problem building HDFS Test Suite

I'm trying to build the HDFS Test Suite per these instructions:   http://wiki.apache.org/hadoop/HowToUseSystemTestFramework I've done a clean install of RHEL 6 and Fedora 16 (vm's).  Both are yum update'ed to latest. Per the instructions, I ran these commands: # git clone git://github.com/apach

Re: Package Dependancy Problem building HDFS Test Suite

; > /usr/bin/build-classpath: error: Could not find jaxp_parser_impl Java > extension for this JVM > /usr/bin/build-classpath: error: Some specified jars were not found > > Does it ring a bell? > Cos > > On Thu, Jan 24, 2013 at 06:57PM, Brad Childs wrote: > &

Package Dependancy Problem building HDFS Test Suite

I'm trying to build the HDFS Test Suite per these instructions: http://wiki.apache.org/hadoop/HowToUseSystemTestFramework Specifically, I ran this: # git clone git://github.com/apache/hadoop-hdfs.git hdfs # cd hdfs # ant test-system -Dhadoop.conf.dir.deployed=/home/bchilds/local/hadoop-1.1.1/c