Re: HDFS 2.6.0 upgrade ends with missing blocks

2015-01-08 Thread dlmarion
age - From: "Colin P. McCabe" To: hdfs-dev@hadoop.apache.org Sent: Thursday, January 8, 2015 2:43:29 PM Subject: Re: HDFS 2.6.0 upgrade ends with missing blocks Hi dlmarion, In general, any upgrade process we do will consume disk space, because it's creating hardlinks and

Re: HDFS 2.6.0 upgrade ends with missing blocks

2015-01-08 Thread Colin P. McCabe
Hi dlmarion, In general, any upgrade process we do will consume disk space, because it's creating hardlinks and a new "current" directory, and so forth. So upgrading when disk space is very low is a bad idea in any scenario. It's certainly a good idea to free up some space before doing the upgrad

Re: HDFS 2.6.0 upgrade ends with missing blocks

2015-01-07 Thread dlmarion
information. - Original Message - From: dlmar...@comcast.net To: hdfs-dev@hadoop.apache.org Sent: Wednesday, January 7, 2015 8:25:41 AM Subject: HDFS 2.6.0 upgrade ends with missing blocks I recently upgraded from CDH 5.1.2 to CDH 5.3.0. I know, contact Cloudera, but this is actually a

HDFS 2.6.0 upgrade ends with missing blocks

2015-01-07 Thread dlmarion
I recently upgraded from CDH 5.1.2 to CDH 5.3.0. I know, contact Cloudera, but this is actually a generic issue. After the upgrade I brought up the DNs and after all of them had checked in I ended up with missing blocks. I tracked this down in the DN logs to an error at startup where the DN is