[jira] [Created] (HDFS-11588) Output Avro format in the offline editlog viewer

Haohui Mai created HDFS-11588: - Summary: Output Avro format in the offline editlog viewer Key: HDFS-11588 URL: https://issues.apache.org/jira/browse/HDFS-11588 Project: Hadoop HDFS Issue Type: Bu

Re: Can we update protobuf's version on trunk?

> On Mar 28, 2017, at 5:09 PM, Chris Douglas wrote: > > I haven't seen data identifying PB as a bottleneck, but the > non-x86/non-Linux and dev setup arguments may make this worthwhile. -C FWIW, we have the same problem with leveldbjni-all. (See the ASF PowerPC build logs) I keep meani

Re: Can we update protobuf's version on trunk?

> We can define protobuf's version by using syntax = "proto2" or syntax > = "proto3" in proto files with proto3 compiler. I think this is what > Stack mentioned as compatibility mode. I mean, "We can define protobuf's 'specification' 'version at compilation time by using syntax = "proto2""... - T

Re: Can we update protobuf's version on trunk?

> Stack mentioned a compatibility mode that uses the proto2 semantics. We can define protobuf's version by using syntax = "proto2" or syntax = "proto3" in proto files with proto3 compiler. I think this is what Stack mentioned as compatibility mode. https://github.com/golang/protobuf/blob/master/p

Re: Can we update protobuf's version on trunk?

On Tue, Mar 28, 2017 at 4:18 PM, Andrew Wang wrote: > Unfortunately, it sounds like these are intrinsic differences with PB3. That's too bad... but possibly not fatal: most of the data we proxy through client code is, if not opaque, it's at least immutable (particularly tokens). If PB3 does suppo

Re: Can we update protobuf's version on trunk?

> > > If unknown fields are dropped, then applications proxying tokens and > other > >> data between servers will effectively corrupt those messages, unless we > >> make everything opaque bytes, which- absent the convenient, prenominate > >> semantics managing the conversion- obviate the compatibil

Re: Can we update protobuf's version on trunk?

On Tue, Mar 28, 2017 at 3:04 PM, Andrew Wang wrote: > There's no mention of the convenient "Embedded messages are compatible with >> bytes if the bytes contain an encoded version of the message" semantics in >> proto3. > > > I checked the proto3 guide, and I think this is supported: > https://deve

[jira] [Resolved] (HDFS-11010) Update to Protobuf 3 in trunk

[ https://issues.apache.org/jira/browse/HDFS-11010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anu Engineer resolved HDFS-11010. - Resolution: Duplicate Let us keep all going forward discussion in HADOOP-13363 > Update to Protob

Re: Can we update protobuf's version on trunk?

I've been investigating this a bit. I'm hoping Chris can ring in, since he's identified wire compatibility issues. Replying inline to Chris' comment

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/359/ [Mar 27, 2017 11:23:37 AM] (yqlin) HDFS-11555. Fix typos in class OfflineImageReconstructor. Contributed by [Mar 27, 2017 12:23:45 PM] (weichiu) HDFS-10506. Addendum patch to include missing changes. Contr

Apache Hadoop qbt Report: trunk+JDK8 on Linux/ppc64le

For more details, see https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-ppc/271/ [Mar 27, 2017 4:01:48 PM] (jeagles) Delay construction of PreCondition.check failure message in [Mar 27, 2017 5:48:44 PM] (jeagles) Configuration#get return value optimization (jeagles) [Mar 27, 2017 8:29:

[jira] [Created] (HDFS-11587) Spelling errors in the Java source

Doris Gu created HDFS-11587: --- Summary: Spelling errors in the Java source Key: HDFS-11587 URL: https://issues.apache.org/jira/browse/HDFS-11587 Project: Hadoop HDFS Issue Type: Improvement