Hi HDFS dev, The HDFS-6584 branch has been merged to trunk. We will finish the following two items before merging it to branch-2.
- HDFS-7081 Add new DistributedFileSystem API for getting all the existing storage policies - HDFS-7095 TestStorageMover often fails in Jenkins Thanks for all the great work! Tsz-Wo On Friday, September 19, 2014 6:19 AM, Tsz Wo Sze <szets...@yahoo.com> wrote: > > >Hi HDFS dev, > > >We have four +1's (Vinay, Jitendra, Arpit and me) and no -1's. The VOTE >passed. > > >PS: Sorry that my email box seems having some problem. I somehow did not >receive Arpit's VOTE and some other emails. The email I sent last time (forwarded below) did not go out. > > > >Thanks everyone. >Tsz-Wo > > > > > > >On Tuesday, September 16, 2014 11:20 PM, Tsz Wo Sze <szets...@yahoo.com> wrote: > > >> >> >>Hi HDFS dev, >> >> >>We have three binding +1's (Vinay, Jitendra and me) and no -1's. The VOTE >>passed. >> >> >>Thanks everyone. >>Tsz-Wo >> >> >> >>On Monday, September 8, 2014 4:03 PM, Nate Payne <npa...@cardinalpath.com> >>wrote: >> >> >>> >>> >>>+1. Great work everyone. >>> >>>On Sun, Sep 7, 2014 at 11:17 PM, Jitendra Pandey <jiten...@hortonworks.com> >>>wrote: >>> >>>> +1. Great work by Nicholas and Jing. >>>> >>>> >>>> On Sun, Sep 7, 2014 at 8:09 PM, Vinayakumar B <vinayakum...@apache.org> >>>> wrote: >>>> >>>> > I have closely observed all work done in this. This featute is very >>>> > important for the storage only problems. >>>> > >>>> > Major work done by Nicholas and later Jing. >>>> > >>>> > Thanks to everyone who has participated in this. >>>> > >>>> > I feel the code is in good state to be merged to trunk. >>>> > +1 for the merge. >>>> > >>>> > Regards, >>>> > Vinay >>>> > On Sep 8, 2014 1:29 AM, "Tsz Wo Sze" <szets...@yahoo.com.invalid> wrote: >>>> > >>>> > > Hi HDFS dev, >>>> > > >>>> > > We would like to propose merging the development branch >>>> > > HDFS-6584 back to trunk. >>>> > > >>>> > > The work of HDFS-6584 is to support Archival Storage in >>>> > > HDFS. Hadoop needs a solution to >>>> > > decouple growing storage capacity from compute capacity. Nodes with >>>> > higher >>>> > > density and less expensive storage with low compute power are becoming >>>> > > available and can be used as cold storage in the clusters. Based on >>>> > > policy, the >>>> > > data from hot can be moved to the cold. Adding more nodes to the cold >>>> > > storage >>>> > > can grow the storage independent of the compute capacity in the >>>> cluster. >>>> > > >>>> > > The Archival Storage feature introduces a new concept of >>>> > > storage policies (Hot, Warm, Cold) to HDFS and allows files to be >>>> stored >>>> > in >>>> > > different storage medias (DISK, ARCHIVE) according to the storage >>>> policy. >>>> > > A new data migration tool is added for >>>> > > archiving data. For more details, please >>>> > > see the design doc posted in HDFS-6584. >>>> > > >>>> > > There are currently 22 sub-tasks in HDFS-6584. The main feature of >>>> > > HDFS-6584 is implemented >>>> > > and tested. The remaining work is adding >>>> > > user documentation, adding a test plan doc, adding more tests and >>>> fixing >>>> > > some >>>> > > minor bugs. We will finish all of the >>>> > > remaining work before merging the branch to trunk. >>>> > > >>>> > > The contributors of this work include Jing Zhao, Arpit >>>> > > Agarwal, Vinayakumar B, Suresh Srinivas, Sanjay Radia, Jitendra Pandey, >>>> > > Haohui >>>> > > Mai and Tsz-Wo Nicholas Sze. We thank >>>> > > the community for giving valuable comments and feedbacks on the design >>>> of >>>> > > this >>>> > > work. >>>> > > >>>> > > The vote will last for 7 days. Of course, I am +1 on it. >>>> > > >>>> > > Regards, >>>> > > Tsz-Wo >>>> > > >>>> > >>>> >>>> >>>> >>>> -- >>>> <http://hortonworks.com/download/> >>> >>>> >>>> -- >>>> CONFIDENTIALITY NOTICE >>>> NOTICE: This message is intended for the use of the individual or entity to >>>> which it is addressed and may contain information that is confidential, >>>> privileged and exempt from disclosure under applicable law. If the reader >>>> of this message is not the intended recipient, you are hereby notified that >>>> any printing, copying, dissemination, distribution, disclosure or >>>> forwarding of this communication is strictly prohibited. If you have >>>> received this communication in error, please contact the sender immediately >>>> and delete it from your system. Thank You. >>>> >>> >>> >>> >>>-- >>>Nathaniel Payne >>>Senior Data Architect >>>phone +1.778.374.3004 x236 >>>web CardinalPath.com >>><http://www.cardinalpath.com/?utm_campaign=cp-personal&utm_source=npayne&utm_medium=email&utm_content=signature> >>> >>>-- >>> >>> >>>Research shows that organizations with high online analytics maturity >>><http://www.cardinalpath.com/services/online-analytics-maturity-model/assessment/?utm_source=footer&utm_medium=email&utm_campaign=cp-personal&utm_content=signature> >>> >>>get better ROI from their digital marketing and analytics investments. Not >>>sure what your organization's analytics maturity is? Do you want to see how >>>you compare to over 900 companies worldwide? Take the Online Analytics >>>Maturity Assessment (OAMA) >>><http://www.cardinalpath.com/services/online-analytics-maturity-model/assessment/?utm_source=footer&utm_medium=email&utm_campaign=cp-personal&utm_content=signature> >>> >>>and find out now! >>> >>>This email, including any attachments, is for the sole use of the intended >>>recipient and may contain confidential information. If you are not the >>>intended recipient, please immediately notify us by reply email or by >>>telephone, delete this email and destroy any copies. Thank you >>> >>> >>> >>> >>> >> >> > >
