>___
>From: Uma Maheswara Rao G
>Sent: Thursday, November 24, 2011 7:51 AM
>To: hdfs-dev@hadoop.apache.org; common-...@hadoop.apache.org
>Subject: RE: Blocks are getting corrupted under very high load
We could replicate the issue with some test
1539.
Regards,
Uma
From: Todd Lipcon [t...@cloudera.com]
Sent: Thursday, November 24, 2011 5:07 AM
To: common-...@hadoop.apache.org
Cc: hdfs-dev@hadoop.apache.org
Subject: Re: Blocks are getting corrupted under very high load
On Wed, Nov 23, 2011 at 1:23 AM,
On Wed, Nov 23, 2011 at 1:23 AM, Uma Maheswara Rao G
wrote:
> Yes, Todd, block after restart is small and genstamp also lesser.
> Here complete machine reboot happend. The boards are configured like, if it
> is not getting any CPU cycles for 480secs, it will reboot himself.
> kernal.hung_ta
reboot happend for DN.
Regards,
Uma
From: Todd Lipcon [t...@cloudera.com]
Sent: Wednesday, November 23, 2011 2:08 PM
To: hdfs-dev@hadoop.apache.org
Subject: Re: Blocks are getting corrupted under very high load
I noticed that the reported block after restart
Lipcon [t...@cloudera.com]
> Sent: Wednesday, November 23, 2011 6:27 AM
> To: common-...@hadoop.apache.org
> Cc: hdfs-dev@hadoop.apache.org
> Subject: Re: Blocks are getting corrupted under very high load
>
> Can you look on the DN in question and see whether it was succesfully
From: Todd Lipcon [t...@cloudera.com]
Sent: Wednesday, November 23, 2011 6:27 AM
To: common-...@hadoop.apache.org
Cc: hdfs-dev@hadoop.apache.org
Subject: Re: Blocks are getting corrupted under very high load
Can you look on the DN in question and see whether it was
Can you look on the DN in question and see whether it was succesfully
finalized when the write finished? It doesn't sound like a successful
write -- should have moved it out of the bbw directory into current/
-Todd
On Tue, Nov 22, 2011 at 3:16 AM, Uma Maheswara Rao G
wrote:
> Hi All,
>
>
>
> I h
Hi All,
I have backported HDFS-1779 to our Hadoop version which is based on 0.20-Append
branch.
We are running a load test, as usual. (We want to ensure the reliability of the
system under heavy loads.)
My cluster has 8 DataNodes and a Namenode
Each machine has 16 CPUs and 12 hard disks, each
