RE: Re: [DISCUSS] Release 0.12.0 (1.0.0)

2024-10-05 Thread Cheng Pan
Hi Sergio > It is possible to include version 1.18.1 of flink in this new version? There were several tries on support Flink 1.18 but not successfully. Flink community decided to deprecate all Scala APIs in Flink 1.18 and remove them in Flink 2.0, the latest try [1] passes the compile but fails

Re: [DISCUSS] Release 0.12.0 (1.0.0)

2024-09-24 Thread Jongyoul Lee
Hello, Thank you for all your opinions and consideration. I appreciate it. To summarize, - Drop Java 8 - Drop Spark 3.2, 3.3, 3.4 and make 3.5 as default - Drop outdated Flink - Support JDK 17 and Spark 4.x - Drop/replace outdated codes/libraries like Raft and docker-client - Introduce new UI - P

Re: [DISCUSS] Release 0.12.0 (1.0.0)

2024-09-12 Thread Philipp Dallig
Hello, Thank you for preparing a new version. We should get rid of Java 8 as soon as possible. There are several libraries that cannot be updated because of Java 8. I tend to prefer to switch directly to JDK17. This is supported by Spark 3.5, for example. Unfortunately, Hadoop 3 does not wor

Re: [DISCUSS] Release 0.12.0 (1.0.0)

2024-09-11 Thread Adam Binford
> > this sounds like a regression that should be fixed, I’m not sure what’s > the issue exactly being This was specifically what I hit: https://github.com/apache/zeppelin/blob/940cf13935ec9ed989c7afeec98447c2e7eb5a7e/zeppelin-zengine/src/main/java/org/apache/zeppelin/notebook/FileSystemStorage.ja

Re: [DISCUSS] Release 0.12.0 (1.0.0)

2024-09-11 Thread Cheng Pan
Adam, good to know that you are working on Spark 4 support, and Spark 4.0 preview2 is likely coming soon. It would be great if you can submit a draft PR even Spark 4.0 is not GA. > it looks like there was a change that forced keytab/principal settings to > only be loaded from env vars or system

Re: [DISCUSS] Release 0.12.0 (1.0.0)

2024-09-11 Thread Adam Binford
+1 for deprecating Java 8 and dropping Spark 3.2. I also have a working version of "unofficial" Spark 4.0 support I can submit a PR for. Unofficial because I don't want to mark 4.0.0 as supported before it's released, but I got the Spark interpreter tests to pass with 4.0.0-preview1. One thing I

Re: [DISCUSS] Release 0.12.0 (1.0.0)

2024-09-10 Thread Cheng Pan
Thanks for bringing up this discussion, generally, I agree that we should have a short release cycle. For the version number, I prefer to 0.12 instead of 1.0, because some interpreters relies on external systems were not fully tested with Java 11, I would like to give it more time to collect us

[DISCUSS] Release 0.12.0 (1.0.0)

2024-09-10 Thread Jongyoul Lee
Hello, I would like to discuss a new release with the community. Here is what we are working on: - Docker enhancement - Java 8 deprecation - New UI - Raft deprecation If you have any questions or ideas for the next release please feel free to leave your comments. Focusing on contributing and re