[Update] RE: Blocks are getting corrupted under very high load

2011-11-25 Thread Uma Maheswara Rao G
>___ >From: Uma Maheswara Rao G >Sent: Thursday, November 24, 2011 7:51 AM >To: hdfs-dev@hadoop.apache.org; common-...@hadoop.apache.org >Subject: RE: Blocks are getting corrupted under very high load We could replicate the issue with some test

RE: Blocks are getting corrupted under very high load

2011-11-23 Thread Uma Maheswara Rao G
1539. Regards, Uma From: Todd Lipcon [t...@cloudera.com] Sent: Thursday, November 24, 2011 5:07 AM To: common-...@hadoop.apache.org Cc: hdfs-dev@hadoop.apache.org Subject: Re: Blocks are getting corrupted under very high load On Wed, Nov 23, 2011 at 1:23 AM,

Re: Blocks are getting corrupted under very high load

2011-11-23 Thread Todd Lipcon
On Wed, Nov 23, 2011 at 1:23 AM, Uma Maheswara Rao G wrote: > Yes, Todd,  block after restart is small and  genstamp also lesser. >   Here complete machine reboot happend. The boards are configured like, if it > is not getting any CPU cycles  for 480secs, it will reboot himself. >  kernal.hung_ta

RE: Blocks are getting corrupted under very high load

2011-11-23 Thread Uma Maheswara Rao G
reboot happend for DN. Regards, Uma From: Todd Lipcon [t...@cloudera.com] Sent: Wednesday, November 23, 2011 2:08 PM To: hdfs-dev@hadoop.apache.org Subject: Re: Blocks are getting corrupted under very high load I noticed that the reported block after restart

Re: Blocks are getting corrupted under very high load

2011-11-23 Thread Todd Lipcon
Lipcon [t...@cloudera.com] > Sent: Wednesday, November 23, 2011 6:27 AM > To: common-...@hadoop.apache.org > Cc: hdfs-dev@hadoop.apache.org > Subject: Re: Blocks are getting corrupted under very high load > > Can you look on the DN in question and see whether it was succesfully

RE: Blocks are getting corrupted under very high load

2011-11-22 Thread Uma Maheswara Rao G
From: Todd Lipcon [t...@cloudera.com] Sent: Wednesday, November 23, 2011 6:27 AM To: common-...@hadoop.apache.org Cc: hdfs-dev@hadoop.apache.org Subject: Re: Blocks are getting corrupted under very high load Can you look on the DN in question and see whether it was

Re: Blocks are getting corrupted under very high load

2011-11-22 Thread Todd Lipcon
Can you look on the DN in question and see whether it was succesfully finalized when the write finished? It doesn't sound like a successful write -- should have moved it out of the bbw directory into current/ -Todd On Tue, Nov 22, 2011 at 3:16 AM, Uma Maheswara Rao G wrote: > Hi All, > > > > I h