Problem reading HDFS block size > 1GB

2009-10-01 Thread Vinay Setty
n Grep or wordcount on the data We have following questions: 1. Does any body know what is the maximum block size and split size supported by HDFS? 2. Did any of you guys try something similar? 3. Did any of you guys get similar problems? If so can you please tell us how you resolved it? Thank you, Vinay Setty

Re: Problem reading HDFS block size > 1GB

2009-10-02 Thread Vinay Setty
p. > > Regd read timeout from DN, could you check log on the datanode as well? > > Raghu. > > On Tue, Sep 29, 2009 at 10:52 AM, Vinay Setty > wrote: > > > Hi all, > > We are running Yahoo distribution of Hadoop based on Hadoop > 0.20.0-2787265 > > . > &g