Re: Multi-Master Hadoop Configuration

2010-10-29 Thread Steve Loughran
On 27/10/10 23:28, Wang, Chengwei wrote: Thanks for pointing it out! Because it did not mentioned how may masters in the practice of 4000 nodes, is there only one master managing 4000 slaves? Given that you can now get 24 TB worth of HDD in a single server, I wouldn't worry that much about

Re: Multi-Master Hadoop Configuration

2010-10-28 Thread Wang, Chengwei
Thanks a bunch! - Original Message - From: "Konstantin Shvachko" To: common-dev@hadoop.apache.org Sent: Thursday, October 28, 2010 5:09:27 PM Subject: Re: Multi-Master Hadoop Configuration Yes. Only one master, called name-node, is managing HDFS, and only one master, called j

Re: Multi-Master Hadoop Configuration

2010-10-28 Thread Konstantin Shvachko
nt: Wednesday, October 27, 2010 6:08:10 PM > Subject: Re: Multi-Master Hadoop Configuration > > > On Oct 27, 2010, at 2:55 PM, Wang, Chengwei wrote: > > > Hi All, > > > > I've searched for a while on the possibility to configure multiple > masters to govern larg

Re: Multi-Master Hadoop Configuration

2010-10-27 Thread Allen Wittenauer
On Oct 27, 2010, at 3:28 PM, Wang, Chengwei wrote: > Thanks for pointing it out! > > Because it did not mentioned how may masters in the practice of 4000 nodes, > is there only one master managing 4000 slaves? Hadoop only supports one master, so yes. [At least until the Avata

Re: Multi-Master Hadoop Configuration

2010-10-27 Thread Wang, Chengwei
M Subject: Re: Multi-Master Hadoop Configuration On Oct 27, 2010, at 2:55 PM, Wang, Chengwei wrote: > Hi All, > > I've searched for a while on the possibility to configure multiple masters to > govern large number of slaves, but I barely found any except for > multi-ma

Re: Multi-Master Hadoop Configuration

2010-10-27 Thread Allen Wittenauer
On Oct 27, 2010, at 2:55 PM, Wang, Chengwei wrote: > Hi All, > > I've searched for a while on the possibility to configure multiple masters to > govern large number of slaves, but I barely found any except for > multi-masters for backup in HBase. Is one master enough to support thousands > of

Multi-Master Hadoop Configuration

2010-10-27 Thread Wang, Chengwei
Hi All, I've searched for a while on the possibility to configure multiple masters to govern large number of slaves, but I barely found any except for multi-masters for backup in HBase. Is one master enough to support thousands of slaves? Or in real we just configure separate Hadoop instances i