RE: is dfsclient caches the data block to local disk before writing?

Thank you dhruba Regards, Gokul _ From: Dhruba Borthakur [mailto:dhr...@gmail.com] Sent: Monday, September 27, 2010 1:30 AM To: hdfs-u...@hadoop.apache.org; gok...@huawei.com Cc: hdfs-dev@hadoop.apache.org Subject: Re: is dfsclient caches the data block to local disk before

Re: is dfsclient caches the data block to local disk before writing?

DFS client does not write the data to local disk first. Instead, it streams data directly to the datanodes in the write pipeline. I will update the document. On Sun, Sep 26, 2010 at 5:21 AM, Gokulakannan M wrote: > Hi, > > > > Is staging still used in hdfs when writing the data? Thi

is dfsclient caches the data block to local disk before writing?

Hi, Is staging still used in hdfs when writing the data? This doubt arose when I was going through the hdfs documents. ref : http://hadoop.apache.org/hdfs/docs/current/hdfs_design.html#Staging I believe dfsclient does not cache the datablock