Re: Exception in mid of reading files.

Divya, thank you for reporting back on this. Nicholas and I had an offline conversation and came to the conclusion that this is likely to be a different problem from HDFS-3373. Although the symptoms look similar, the socket caching code mentioned in HDFS-3373 is not present in branch-1. I filed

Re: Exception in mid of reading files.

Hi Chris, Thanks a lot for the help. But after lot of investigation I found that the issue was with the cached socket connection which was raised as a bug by Nicholas. Bug details are as follows, HDFS-3373 FileContext HDFS implementation can lea

Re: Exception in mid of reading files.

Hi Divya, The exceptions indicate that the HDFS client failed to establish a network connection to a datanode hosting a block that the client is trying to read. After too many of these failures (default 3, but configurable), the HDFS client aborts the read and this bubbles up to the caller with t

Exception in mid of reading files.

Hi Guys, I'm indexing data (~50 -100GB per day) from hadoop. Hadoop is Running in cluster mode (having 2 dataNaodes currently). After every two or three hours I'm getting this exception. But both Data nodes are up and running. Can any one please guide me as to what I should do or If I'm doing