Re: questions regarding fuse_dfs_read

2011-09-09 Thread Aastha Mehta
Thanks Brian. That helped. Regards, Aastha. On 7 September 2011 17:45, Brian Bockelman wrote: > Hi Aastha, > > A read-ahead buffer is a common technique to trade higher bandwidth for > lower latency for a number of common read patterns. Your OS does something > similar (a much more advanced te

Re: questions regarding fuse_dfs_read

2011-09-07 Thread Brian Bockelman
Hi Aastha, A read-ahead buffer is a common technique to trade higher bandwidth for lower latency for a number of common read patterns. Your OS does something similar (a much more advanced technique though). By reading ahead, HDFS is betting that your reads have a pattern to it. I think the 1

questions regarding fuse_dfs_read

2011-09-06 Thread Aastha Mehta
Hello, I am using FUSE-DFS with HDFS for a project. I have to modify the read and write functions of fuse_dfs. I have few questions regarding the fuse_dfs_read code. There is an rdbuffer_size variable associated with the dfs_context, which is by default initialized to 10M. What is this rdbuffer_si