Hi Hive folks, I am from OpenLab[1] team, which is an open source organisation for open source projects testing and integration to enrich the software ecosystem. How we do that is mainly denpending on an OpenLab CI system[2] with a resource pool, that allow to run projects' building, installation, integration and testing automatically. We have done some projects integration with OpenLab CI, many of them are tested around the OpenStack Cloud and K8s platform, such as Terraform[3] and Containerd[4]. Because we have customers require to run the Hive on ARM servers, and we are not sure if Hive can work well on ARM64 servers, and not sure if there is such as guarantee infrasturctures. At this stage, one of the OpenLab Team's global goal is to make more opensource projects to be more compatible for ARM64 platforms, it allow operators easily to do building, integration, testing of any opensource projects hosted on Github. So if there isn't a similar infrastructure to so these in Apache community, I think the OpenLab CI would be a good choice :)
We are pleasure to provider ARM64 servers(VMs) from the OpenLab resource pool and add simple CI job to run the build task of Hive. Which may be a periodic CI job running with a certain time per day, or a job perform a "code merging gating" mechanism and will be triggered when every patch/PR submitted to the Hive repo. After support the building process, we can also add to support run the basic integration tests of Hive in the CI job to make sure the basic funcionalities work well. If there is difficulty for Hive community to accept a thirdparty CI system and there is already one for ARM building, we can also help to donate some ARM resources if needed. Actually, Hive building has been broken in ARM(aarch64) server due to the dependent "protoc:2.5.0" package issue. There is a similar issue has also been found for HBase[6], I have add a PoC testing job to show this issue based on the OpenLab CI infrastructure(an experimental CI env, not our offical env), you can see the Hive building failed in in the building logs[7](the "logs/hive_building.log" in the link) and the Hive building sucessfully in building logs[8]. the PR[8] has fixed the "protoc:2.5.0" package issue by changing its artifact in related "pom.xml". For this issue, I have attatched a patch attachment. If we have a CI system to ensure the Hive building on ARM platform, the bugs like this will be found at first time. If is possible this proposal be accepted, I am glad to do this and will maintain the ARM CI job in the future, also, if there are some issues break the building process, I will also try to report and fix in Hive. [1] http://openlabtesting.org [2] http://status.openlabtesting.org/ [3] https://github.com/terraform-providers/terraform-provider-openstack/issues/181 [4] https://github.com/containerd/containerd/pull/3242 [5] http://zuul-ci.org/docs/ [6] https://issues.apache.org/jira/browse/HBASE-19146 [7] https://github.com/liu-sheng/hive/pull/2#issuecomment-505786879 [8] https://github.com/liu-sheng/hive/pull/3#issuecomment-505799649 Thanks for your attention.
