Hi all, I commented on HDFS-6584 with some feedback. Overall, the design looks reasonable and I think most of it can be addressed after the merge, though I'd appreciate a design doc rev and user docs that try to answer some of these questions.
Thanks, Andrew On Mon, Sep 8, 2014 at 7:44 PM, Arpit Agarwal <aagar...@hortonworks.com> wrote: > +1 > > I reviewed the feature design and have followed the development. It is > ready for merging into trunk. > > > On Mon, Sep 8, 2014 at 1:03 AM, Nate Payne <npa...@cardinalpath.com> > wrote: > > > +1. Great work everyone. > > > > On Sun, Sep 7, 2014 at 11:17 PM, Jitendra Pandey < > jiten...@hortonworks.com > > > > > wrote: > > > > > +1. Great work by Nicholas and Jing. > > > > > > > > > On Sun, Sep 7, 2014 at 8:09 PM, Vinayakumar B <vinayakum...@apache.org > > > > > wrote: > > > > > > > I have closely observed all work done in this. This featute is very > > > > important for the storage only problems. > > > > > > > > Major work done by Nicholas and later Jing. > > > > > > > > Thanks to everyone who has participated in this. > > > > > > > > I feel the code is in good state to be merged to trunk. > > > > +1 for the merge. > > > > > > > > Regards, > > > > Vinay > > > > On Sep 8, 2014 1:29 AM, "Tsz Wo Sze" <szets...@yahoo.com.invalid> > > wrote: > > > > > > > > > Hi HDFS dev, > > > > > > > > > > We would like to propose merging the development branch > > > > > HDFS-6584 back to trunk. > > > > > > > > > > The work of HDFS-6584 is to support Archival Storage in > > > > > HDFS. Hadoop needs a solution to > > > > > decouple growing storage capacity from compute capacity. Nodes with > > > > higher > > > > > density and less expensive storage with low compute power are > > becoming > > > > > available and can be used as cold storage in the clusters. Based on > > > > > policy, the > > > > > data from hot can be moved to the cold. Adding more nodes to the > cold > > > > > storage > > > > > can grow the storage independent of the compute capacity in the > > > cluster. > > > > > > > > > > The Archival Storage feature introduces a new concept of > > > > > storage policies (Hot, Warm, Cold) to HDFS and allows files to be > > > stored > > > > in > > > > > different storage medias (DISK, ARCHIVE) according to the storage > > > policy. > > > > > A new data migration tool is added for > > > > > archiving data. For more details, please > > > > > see the design doc posted in HDFS-6584. > > > > > > > > > > There are currently 22 sub-tasks in HDFS-6584. The main feature of > > > > > HDFS-6584 is implemented > > > > > and tested. The remaining work is adding > > > > > user documentation, adding a test plan doc, adding more tests and > > > fixing > > > > > some > > > > > minor bugs. We will finish all of the > > > > > remaining work before merging the branch to trunk. > > > > > > > > > > The contributors of this work include Jing Zhao, Arpit > > > > > Agarwal, Vinayakumar B, Suresh Srinivas, Sanjay Radia, Jitendra > > Pandey, > > > > > Haohui > > > > > Mai and Tsz-Wo Nicholas Sze. We thank > > > > > the community for giving valuable comments and feedbacks on the > > design > > > of > > > > > this > > > > > work. > > > > > > > > > > The vote will last for 7 days. Of course, I am +1 on it. > > > > > > > > > > Regards, > > > > > Tsz-Wo > > > > > > > > > > > > > > > > > > > > > -- > > > <http://hortonworks.com/download/> > > > > > > -- > > > CONFIDENTIALITY NOTICE > > > NOTICE: This message is intended for the use of the individual or > entity > > to > > > which it is addressed and may contain information that is confidential, > > > privileged and exempt from disclosure under applicable law. If the > reader > > > of this message is not the intended recipient, you are hereby notified > > that > > > any printing, copying, dissemination, distribution, disclosure or > > > forwarding of this communication is strictly prohibited. If you have > > > received this communication in error, please contact the sender > > immediately > > > and delete it from your system. Thank You. > > > > > > > > > > > -- > > Nathaniel Payne > > Senior Data Architect > > phone +1.778.374.3004 x236 > > web CardinalPath.com > > < > > > http://www.cardinalpath.com/?utm_campaign=cp-personal&utm_source=npayne&utm_medium=email&utm_content=signature > > > > > > > -- > > > > > > Research shows that organizations with high online analytics maturity > > < > > > http://www.cardinalpath.com/services/online-analytics-maturity-model/assessment/?utm_source=footer&utm_medium=email&utm_campaign=cp-personal&utm_content=signature > > > > > get better ROI from their digital marketing and analytics investments. > Not > > sure what your organization's analytics maturity is? Do you want to see > how > > you compare to over 900 companies worldwide? Take the Online Analytics > > Maturity Assessment (OAMA) > > < > > > http://www.cardinalpath.com/services/online-analytics-maturity-model/assessment/?utm_source=footer&utm_medium=email&utm_campaign=cp-personal&utm_content=signature > > > > > and find out now! > > > > This email, including any attachments, is for the sole use of the > intended > > recipient and may contain confidential information. If you are not the > > intended recipient, please immediately notify us by reply email or by > > telephone, delete this email and destroy any copies. Thank you > > > > > > -- > CONFIDENTIALITY NOTICE > NOTICE: This message is intended for the use of the individual or entity to > which it is addressed and may contain information that is confidential, > privileged and exempt from disclosure under applicable law. If the reader > of this message is not the intended recipient, you are hereby notified that > any printing, copying, dissemination, distribution, disclosure or > forwarding of this communication is strictly prohibited. If you have > received this communication in error, please contact the sender immediately > and delete it from your system. Thank You. >
