RE: is dfsclient caches the data block to local disk before writing?

2010-09-26 Thread Gokulakannan M
writing? DFS client does not write the data to local disk first. Instead, it streams data directly to the datanodes in the write pipeline. I will update the document. On Sun, Sep 26, 2010 at 5:21 AM, Gokulakannan M wrote: Hi, Is staging still used in hdfs when writing the

is dfsclient caches the data block to local disk before writing?

2010-09-26 Thread Gokulakannan M
Hi, Is staging still used in hdfs when writing the data? This doubt arose when I was going through the hdfs documents. ref : http://hadoop.apache.org/hdfs/docs/current/hdfs_design.html#Staging I believe dfsclient does not cache the datablock

libhdfs install error

2010-01-13 Thread Gokulakannan M
Hi, I am trying to install libhdfs for Scribe-HDFS integration. I am using hadoop0.20.1in SUSE linux 10 sp 2 . These are the steps I follow. in hadoop/src/c++/libhdfs ./configure --enable-static --disable-shared