Re: Question about using Tar with Hadoop files

2011-12-22 Thread Stefan Bodewig
On 2011-12-22, Stefan Bodewig wrote: > On 2011-12-19, Frank Astier wrote: > Later versions of tar support workarounds (namely ustar later used by > GNU tar and BSD tar aswell) and even later the newer POSIX standard > added PAX extension headers to address this (and other things like file > names

Re: Question about using Tar with Hadoop files

2011-12-22 Thread Stefan Bodewig
On 2011-12-19, Frank Astier wrote: > I’m trying to use the Apache Tar package (1.8.2) for a Java program > that tars large files in Hadoop. I am currently failing on a file > that’s 17 GB long. First of all, do yourself a favor and use Commons Compress rather than Ant's tar package. Traditional

Re: Question about using Tar with Hadoop files

2011-12-20 Thread Andy Stevens
You didn't mention what version of Ant was involved... Andy. On 20 Dec 2011 05:31, "Frank Astier" wrote: > Hi - > > I’m trying to use the Apache Tar package (1.8.2) for a Java program that > tars large files in Hadoop. I am currently failing on a file that’s 17 GB > long. Note that this code wor

Question about using Tar with Hadoop files

2011-12-19 Thread Frank Astier
Hi - I’m trying to use the Apache Tar package (1.8.2) for a Java program that tars large files in Hadoop. I am currently failing on a file that’s 17 GB long. Note that this code works without any problem for smaller files. I’m tarring smaller HDFS files all day long without any problem. It fail