Re: Wire compatibility between Hadoop 3.x client and 2.x server

2020-10-12 Thread Zhenyu Zheng
Hi, I'm not a Hadoop expert but I've had some experiences in the cloud infrastructure that I think also makes sense in your case. For 2.x client + 3.x Server case, the Server side can obviously provide compatibility, so it should work fine. But in the opposite case, it might have problem, because

Re: Progress

2020-07-22 Thread Zhenyu Zheng
Thanks for doing this, I was going to post in the JIRA about this yesterday but was disturbed by something, please help us migrate the ARM nodes. BR, On Thu, Jul 23, 2020 at 1:40 AM Gavin McDonald wrote: > Hi , > > On Wed, Jul 22, 2020 at 7:00 PM Akira Ajisaka wrote: > > > +CC: common-dev@hado

Re: [VOTE] Release Apache Hadoop 3.3.0 - RC0

2020-07-10 Thread Zhenyu Zheng
+1 (non-binding) - Verified all hashes and checksums - Tested on ARM platform for the following actions: + Built from source on Ubuntu 18.04, OpenJDK 8 + Deployed a pseudo cluster + Ran some example jobs(grep, wordcount, pi) + Ran teragen/terasort/teravalidate + Ran TestDFSIO job BR, Z

[jira] [Resolved] (HADOOP-16766) Increase timeout for RPCCallBenckmark.testBenchmarkWithProto()

2019-12-18 Thread Zhenyu Zheng (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-16766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenyu Zheng resolved HADOOP-16766. --- Resolution: Invalid > Increase timeout for RPCCallBenckmark.testBenchmarkWithPr

[jira] [Created] (HADOOP-16766) Increase timeout for RPCCallBenckmarik.testBenchmarkWithProto()

2019-12-16 Thread Zhenyu Zheng (Jira)
Zhenyu Zheng created HADOOP-16766: - Summary: Increase timeout for RPCCallBenckmarik.testBenchmarkWithProto() Key: HADOOP-16766 URL: https://issues.apache.org/jira/browse/HADOOP-16766 Project: Hadoop

Re: Some updates for Hadoop on ARM and next steps

2019-11-27 Thread Zhenyu Zheng
it's better to make @Chris Thistlethwaite > know > this email. Could you please give some kind advices? Thank you. > > BR > > ZhaoBo > > > > [image: Mailtrack] > <https://mailtrack.io?utm_source=gmail&utm_medium=signature&utm_campaign=signaturevirality5&

Some updates for Hadoop on ARM and next steps

2019-11-22 Thread Zhenyu Zheng
Hi Hadoop, First off, I want to thanks to Wei-Chiu for having me on the last week's Hadoop community sync to introduce our ideas of ARM support on Hadoop. And also for all the attendees for listening and providing suggestions. I want to provide some update on the status: 1. Our teammate has

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-10-22 Thread Zhenyu Zheng
if we can make use >>> > of org.xolstice.maven.plugins:protobuf-maven-plugin, our upgrade to >>> 3.0.0 >>> > of protobuf will also be more easier. >>> > >>> > However i think its better to do this effort in trunk itself. >>> > In of

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-10-12 Thread Zhenyu Zheng
protobuf-maven-plugin, our upgrade to >>> 3.0.0 >>> > of protobuf will also be more easier. >>> > >>> > However i think its better to do this effort in trunk itself. >>> > In offline talks, few members were interested to start 3.3.0 r

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-09-04 Thread Zhenyu Zheng
and work against us. > >> > >> If we work off the Hadoop version 3 — and assume that we have "shading" > in > >> place for all deployments; it might be possible to get there; still a > >> daunting task. > >> > >> So best of luck with t

Re: [DISCUSS] ARM/aarch64 support for Hadoop

2019-09-01 Thread Zhenyu Zheng
Hi, Thanks Vinaya for bring this up and thanks Sheng for the idea. A separate branch with it's own ARM CI seems a really good idea. By doing this we won't break any of the undergoing development in trunk and a CI can be a very good way to show what are the current problems and what have been fixed

Re: Hadoop-trunk commit jenkins job fails due to wrong version of protoc

2019-08-01 Thread Zhenyu Zheng
Or according to the BUILDING.txt in hadoop repo, protobuf-compiler is installed and also according to https://packages.ubuntu.com/search?keywords=protobuf-compiler&searchon=names the version is 3.0 On Thu, Aug 1, 2019 at 7:59 PM Szilard Nemeth wrote: > Hi, > > All hadoop-trunk builds are failing

Re: Hadoop-trunk commit jenkins job fails due to wrong version of protoc

2019-08-01 Thread Zhenyu Zheng
Hi, I'm quite new to hadoop and not very sure whether it is correct or not. By checking the latest successful build log: https://builds.apache.org/job/Hadoop-trunk-Commit/lastSuccessfulBuild/consoleFull it seems the os version is ubuntu 14.04 and in the later failling jobs, the os version is 18.0

Re: Hadoop-trunk commit jenkins job fails due to wrong version of protoc

2019-08-01 Thread Zhenyu Zheng
Hi, I'm quite new to hadoop and not very sure whether it is correct or not. By checking the latest successful build log: https://builds.apache.org/job/Hadoop-trunk-Commit/lastSuccessfulBuild/consoleFull it seems the os version is ubuntu 14.04 and in the later failling jobs, the os version is 18.0

Re: Aug Hadoop Community Meetup in China

2019-07-22 Thread Zhenyu Zheng
Hi, I'm quite interested in this, any updates on event details? BR On Sun, Jul 21, 2019 at 12:29 AM Xiaoqiao He wrote: > Thanks Junping for organizing the event. Looking forward to the coming > meetup. > > BTW, It is hoped to keep running regular Hadoop Contributors Meetups in > China. > > On F

[Hadoop] Question about protobuf

2019-07-08 Thread Zhenyu Zheng
Hi Hadoop: I was trying to build Hadoop on AArch64 platform recently, and I've encontered some issues, one of them is about protobuf 2.5.0, the lowest version of protobuf can be provided on AArch64 is 2.6.1 and that causes version mismatch error when try to build Hadoop as hadoop requires 2.5.0, I

Proposal to make Hadoop more compatible with AArch64 platforms

2019-06-18 Thread Zhenyu Zheng
Hi Hadoop, Some of you might see the related proposal in JIRA( https://issues.apache.org/jira/browse/HADOOP-16358) already, but I want to raise it to a wider audience and clarify some potential misunderstandings. I’m from OpenLab team(https://openlabtesting.org/ ,a community to do open source

[jira] [Created] (HADOOP-16358) Add an ARM CI for Hadoop

2019-06-10 Thread Zhenyu Zheng (JIRA)
Zhenyu Zheng created HADOOP-16358: - Summary: Add an ARM CI for Hadoop Key: HADOOP-16358 URL: https://issues.apache.org/jira/browse/HADOOP-16358 Project: Hadoop Common Issue Type: Improvement