Re: HDFS 2.6.0 upgrade ends with missing blocks

2015-01-08 Thread dlmarion
age - From: "Colin P. McCabe" To: hdfs-dev@hadoop.apache.org Sent: Thursday, January 8, 2015 2:43:29 PM Subject: Re: HDFS 2.6.0 upgrade ends with missing blocks Hi dlmarion, In general, any upgrade process we do will consume disk space, because it's creating hardlinks and

Re: HDFS 2.6.0 upgrade ends with missing blocks

2015-01-08 Thread Colin P. McCabe
Hi dlmarion, In general, any upgrade process we do will consume disk space, because it's creating hardlinks and a new "current" directory, and so forth. So upgrading when disk space is very low is a bad idea in any scenario. It's certainly a good idea to free up some space before doing the upgrad

Re: HDFS 2.6.0 upgrade ends with missing blocks

2015-01-07 Thread dlmarion
I went back and read through the comments in HDFS-6482 and found that the restrictions (question #2 below) have already been documented at https://wiki.apache.org/hadoop/FAQ#On_an_individual_data_node.2C_how_do_you_balance_the_blocks_on_the_disk.3F I will update HDFS-1312 with this information