Re: Contributing to HDFS - Distributed Computing

2009-09-01 Thread Dhruba Borthakur
Hi Brian, That is a good idea. Other block placement algorithms to try (using HDFS-385) would be place blocks using heat-map-topology of a data center, or using a dynamic network topology (based on network performance instead of the static network topology that HDFS currently uses), simulate a a n

Re: Contributing to HDFS - Distributed Computing

2009-09-01 Thread Brian Bockelman
Hey all, One place which would be an exceptionally good research project is the new pluggable interface for replica placement. https://issues.apache.org/jira/browse/HDFS-385 It's something which taps into many lines of CS research (such as scheduling) and is meant to be experimental for a

Re: Contributing to HDFS - Distributed Computing

2009-09-01 Thread Steve Loughran
Hrishikesh Mantri wrote: Hi All. I am Masters student in CS . We are a group of two and are looking for adding some additional features to the HDFS as a part of the Distributed Computing course project . Can someone please provide us with pointers as in which direction we should take so that i

Re: Contributing to HDFS - Distributed Computing

2009-08-31 Thread Hrishikesh Mantri
Thanks Aman. Regards, Hrishi From: Amandeep Khurana To: common-dev@hadoop.apache.org Sent: Sunday, August 30, 2009 6:41:17 PM Subject: Re: Contributing to HDFS - Distributed Computing http://wiki.apache.org/hadoop/ProjectSuggestions Amandeep Khurana

Re: Contributing to HDFS - Distributed Computing

2009-08-30 Thread Amandeep Khurana
http://wiki.apache.org/hadoop/ProjectSuggestions Amandeep Khurana Computer Science Graduate Student University of California, Santa Cruz On Sun, Aug 30, 2009 at 2:16 PM, Hrishikesh Mantri wrote: > Hi All. > > I am Masters student in CS . We are a group of two and are looking for > adding some