2023-03-15 Minutes of the bi-weekly meeting of Apache Linkis 1. The latest version of Apache Linkis is synchronized. -- Wang Heping
(1) EC containerization, hive support for multi-concurrency, and support for docking object storage have all been implemented. https://github.com/orgs/apache/projects/195 2. Apache Linkis 1.3.2 Progress synchronization. -- Xi Shihao/Tao Zhiqiang/Qiao Mu/Guo Fei (1) Linkis hadoop multi-version support, and the pr has been merged. -- Guo Fei (2) 1.3.2 Progress synchronization, in test. -- Xi ShiHao (3) Engine parameter management, and the pr has been merged. -- Tao Zhiqiang/Chen Feiyang 3. Apache Linkis version 1.4.0 leads and requirements discussions. -- Guo Fei (1) Hadoop, Hive, and Spark dependencies are reduced, reducing compilation and installation failures caused by cluster environment (APACHE, CDH, HDP) and basic engine version issues (Hadoop/Hive/Spark) when new users install, And under development. - Guo Fei (2) Hadoop, Hive, Spark, etc. default compilation is modified to a high version to solve security-related problems, and the pr has been merged. --Guo Fei (3) Doris and Impala Engine plugin, (The impla has a java SDK, under development, expected to be submitted in April) --- Huang Dingqi (4) Entrance High Availability PR has been submitted. -- Guo Shupei (5) About ten unassociated issiue need to be processed in 1.4.0, welcome to claim - Xia Chen (6) The registry supports Nacos, has been tested, PR is to be submitted, and the support of the configuration center --- Wang Zhen 4. Apache Linkis community operation progress synchronization. -- Li Wen 5. Other discussions (1) Discussion about scriptis supporting git. -- Zhang Huajin (2) Environmental availability detection script tool (verify the availability of underlying components such as YARN queues, Hive clusters and Linkis basic services through scripts and honeypot data) -- Chen Xia (3) Error code module refactoring. (4) Open Source Summer Campaign. (5) Scripts + Linkis management desk web package, deployed together. 6. The moderator of the next regular meeting (2023/03/29) -- Bao Yang ********************************************************************************************************* 2023-03-15 Apache Linkis 双周例会会议纪要 1.【固定议题】Apache Linkis版本进展同步。---王和平 1. EC 容器化、hive支持多并发、支持对接对象存储都已经实现中 https://github.com/orgs/apache/projects/195 2.【固定议题】Apache Linkis 1.3.2 进展同步。 —— 郗世豪/陶志强/乔木/郭飞 a、 linkis hadoop多版本支持 郭飞--代码已合入 b、1.3.2进展 郗世豪 ---测试中 c、引擎参数管理 陶志强/陈飞扬 -- 代码已合入 3.【固定议题】Apache Linkis 1.4.0版本主导及需求讨论。 —— 郭飞 a. hadoop、hive、spark依赖性降低,减少新用户安装时因为集群环境(apache、cdh、hdp)和基础引擎版本问题(hadoop/hive/spark)导致的编译和安装失败问题--郭飞 --开发中 b. hadoop、hive、spark等默认编译修改为高版本,解决安全相关问题 --郭飞(增加spark版本校验) --代码已合入 c. Doris 和 Impala 引擎插件(impla 有java sdk,正在开发中,预计4月份提交)---黄定琦 -- 开发中 d. entrance 高可用 PR已经提交-- 郭书培 pr已提交 e.未关联issiue大约十个需要在1.4.0处理,欢迎大家认领 --夏晨 f. 注册中心支持Nacos,进行了测试,PR待提交,加配置中心的支持---王震 4.【固定议题】Apache Linkis 社区运营 进展同步。 —— 李文 5.【固定议题】下一场例会的主持人,欢迎认领(2023/03/29)——鲍洋 。 6.【临时议题】 关于scriptis支持git的讨论 -张华金 7.【临时议题】 补充一个临时议题,环境可用性检测脚本工具(通过脚本以及蜜罐数据方式,验证如yarn队列,hive集群等底层组件以及linkis基础服务的可用性)——夏晨 https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa LKIP 31 错误码模块重构 https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa LKIP 30 开源之夏活动 https://docs.qq.com/doc/DVU9qb0dnU3lJTmdJ 8.【临时议题】 Scripts + Linkis管理台的web包,一起部署