[ANNOUNCE] Apache Linkis 1.3.1 available

2023-01-19 Thread 朱辉
Hi all, Apache Linkis Team is glad to announce the new release of Apache Linkis 1.3.1. Apache Linkis builds a computation middleware layer to decouple the upper applications and the underlying data engines, provides standardized interfaces (REST, JDBC, WebSocket etc.) to easily connect to various

[DISCUSS]Specify the hadoop version and shared dependency

2023-01-19 Thread kinsanities
Xu Ling 09:42Is it possible to add a spark-2.4 profile to the spark-plugin to specify the hadoop version and shared dependency? Because this shared doesn't seem to be useful for hadoop3 with normally supported versions My spark is 3.2 not 2.4 fly-cutterThis is OK. If users repackage spar

[DISCUSS]Change profile name

2023-01-19 Thread kinsanities
Xu Ling 10:03 The profile name can be changed, for example, spark-2.4-on-hadoop3. Is this feasible? fly-cutter Do we need to add a spark3 profile if we add spark 2.x? spark seems to have some version dependencies related to scala Xu Ling https://github.com/jackxu2011/linkis/blob/feature-p