Sorry to hijack the thread but, I also wanted to mention Avro. See HADOOP-9672. The version we are using has memory leak and inefficiency issues. We've seen users running into it.
Kihwal ________________________________ From: Tsuyoshi OZAWA <ozawa.tsuyo...@gmail.com> To: "common-dev@hadoop.apache.org" <common-dev@hadoop.apache.org> Cc: "hdfs-...@hadoop.apache.org" <hdfs-...@hadoop.apache.org>; "yarn-...@hadoop.apache.org" <yarn-...@hadoop.apache.org>; "mapreduce-...@hadoop.apache.org" <mapreduce-...@hadoop.apache.org> Sent: Thursday, August 8, 2013 1:59 AM Subject: Re: Upgrade to protobuf 2.5.0 for the 2.1.0 release, HADOOP-9845 Hi, About Hadoop, Harsh is dealing with this problem in HADOOP-9346. For more detail, please see the JIRA ticket: https://issues.apache.org/jira/browse/HADOOP-9346 - Tsuyoshi On Thu, Aug 8, 2013 at 1:49 AM, Alejandro Abdelnur <t...@cloudera.com> wrote: > I' like to upgrade to protobuf 2.5.0 for the 2.1.0 release. > > As mentioned in HADOOP-9845, Protobuf 2.5 has significant benefits to > justify the upgrade. > > Doing the upgrade now, with the first beta, will make things easier for > downstream projects (like HBase) using protobuf and adopting Hadoop 2. If > we do the upgrade later, downstream projects will have to support 2 > different versions and they my get in nasty waters due to classpath issues. > > I've locally tested the patch in a pseudo deployment of 2.1.0-beta branch > and it works fine (something is broken in trunk in the RPC layer YARN-885). > > Now, to do this it will require a few things: > > * Make sure protobuf 2.5.0 is available in the jenkins box > * A follow up email to dev@ aliases indicating developers should install > locally protobuf 2.5.0 > > Thanks. > > -- > Alejandro
