Re: Use VIP for DataNodes

2011-01-31 Thread Allen Wittenauer
FWIW, Y! and LI (and I'm sure others) have been using failover A records for years. The only known problem/limitation is exactly what Dhruba states. On Jan 29, 2011, at 11:19 PM, Dhruba Borthakur wrote: > If you want to protect urself against a rack-switch failure, then you would > wa

Re: Use VIP for DataNodes

2011-01-29 Thread Dhruba Borthakur
If you want to protect urself against a rack-switch failure, then you would want to keep ur primary and standby on machines in different racks. Typically, machines in different racks have different subnets. thanks dhruba On Wed, Jan 26, 2011 at 7:10 AM, mac fang wrote: > Hi, dhruba, > > Thanks

Re: Use VIP for DataNodes

2011-01-26 Thread mac fang
Hi, dhruba, Thanks for sharing. Seems we only need to let NameNode & Backup Node in the same subnet. Why it is a main problem? regards macf On Wed, Jan 26, 2011 at 4:14 PM, Harsh J wrote: > Thank you for correcting that :) > > On Wed, Jan 26, 2011 at 11:17 AM, Dhruba Borthakur > wrote: > > Fb

Re: Use VIP for DataNodes

2011-01-26 Thread Harsh J
Thank you for correcting that :) On Wed, Jan 26, 2011 at 11:17 AM, Dhruba Borthakur wrote: > Fb does not use the VIP approach, we tried that but quickly found out some > limitations, one main problem being that the failover server pair has to be > in the same subnet (for VIP to work). Instead we

Re: Use VIP for DataNodes

2011-01-25 Thread Dhruba Borthakur
Fb does not use the VIP approach, we tried that but quickly found out some limitations, one main problem being that the failover server pair has to be in the same subnet (for VIP to work). Instead we now use the AvatarNode integrated with Zookeeper. -dhruba On Tue, Jan 25, 2011 at 6:12 PM, Harsh

Re: Use VIP for DataNodes

2011-01-25 Thread mac fang
Thanks, Harsh. Any issues you see if we use this? I've already done some researches of this approach. However i am NOT sure if there has some potential risks if we use VIP (i am NOT a seasoned hadooper :) ) regards macf On Wed, Jan 26, 2011 at 10:12 AM, Harsh J wrote: > This is a good approach

Re: Use VIP for DataNodes

2011-01-25 Thread Harsh J
This is a good approach, is used by many to mask the NameNode address for the DataNodes; and is also good to use while using BackupNode (Even Facebook does this). On Wed, Jan 26, 2011 at 7:38 AM, mac fang wrote: > Hi, guys, > > Do we have any plan to enable VIP between NameNode and DataNodes, I m

Use VIP for DataNodes

2011-01-25 Thread mac fang
Hi, guys, Do we have any plan to enable VIP between NameNode and DataNodes, I mean multiple NameNodes and we use a VIP stands before the NNs. Then DNs only need to connect to the VIP. I don't know if it is valuable we have this impl in our hdsf and if there has any issues? Any hints are valuable