Hi Vivian. Take a look at TextInputFormat and the RecordReader classes. This
is set via JobConf.setInputFormat().
-Chuck
-Original Message-
From: Vivi Lang [mailto:sqlxwei...@gmail.com]
Sent: Wednesday, September 12, 2012 5:10 PM
To: hdfs-dev@hadoop.apache.org
Subject: Question about
Hi
n Mon, Oct 31, 2011 at 9:27 AM, Charles Baker wrote:
> Hey guys. Thanks for the replies. Fully qualified symbolic links are
> problematic in that when we wish to restore a directory structure
containing
> symlinks from HDFS to local filesystem, the relativity is lost. For
instance:
>
gt; that use FileSystem to access paths with symlinks will fail.
>
> Btw when looking at the code you pointed out I noticed a bug in link
> resolution (HADOOP-7783), thanks!
>
> Thanks,
> Eli
>
>
> On Fri, Oct 28, 2011 at 9:46 AM, Charles Baker wrote:
>> Hey gu
Oh, and sorry about the signature. The mailserver injects that
automatically...
-Chuck
-Original Message-
From: Charles Baker [mailto:cba...@sdl.com]
Sent: Friday, October 28, 2011 9:47 AM
To: hdfs-dev@hadoop.apache.org
Subject: relative symbolic links in HDFS
Hey guys. We are in the
Hey guys. We are in the early stages of planning and evaluating a hadoop
'cold-storage' cluster for medium to long term storage of mixed data (small
to large files, zips, tar, etc...) and tons of symlinks. We do realize that
small files aren't ideal in HDFS but it's for long-term storage and beats
