Re: [DISCUSS] SPARK-51318: Remove `jar` files from Apache Spark repository and disable affected tests

2025-02-26 Thread Yang Jie
+1, Agree to remove the jar files from the Apache Spark repository and disable the affected tests. For the current test scenarios that use jar files, I believe we can definitely find a more reasonable testing approach. Thanks, Jie Yang On 2025/02/26 16:57:45 "Rozov, Vlad" wrote: > +1 on fixi

Re: [DISCUSS] SPARK-51318: Remove `jar` files from Apache Spark repository and disable affected tests

2025-02-26 Thread Rozov, Vlad
+1 on fixing test jars, though the way how it is fixed needs to be discussed, IMO. In the short term removing jars may still be the best option to satisfy ASF legal policy and avoid release removal. AFAIK, ASF mandates that users and developers have source code that they build from (source rele

Re: [DISCUSS] SPARK-51318: Remove `jar` files from Apache Spark repository and disable affected tests

2025-02-26 Thread Sean Owen
I'd go along with that tradeoff, if the tests aren't that important - are they? I didn't see any discussion of what if anything we lose. I don't find the 'literal' interpretation compelling; the vulnerability one is, though, I don't think there is any evidence it affects these .jars. On Wed, Feb 2

[VOTE][RESULT] SPIP: Add the TIME data type

2025-02-26 Thread Max Gekk
The vote passes with 23 +1s (11 binding +1s). Thanks to all who helped with the vote! (* = binding) +1: - Dongjoon Hyun * - Mich Talebzadeh - Reynold Xin * - Jules Damji - Angel Alvarez Pascua - Fokko Driesprong - L. C. Hsieh * - Serge Rielau - Huaxin Gao * - John Zhuge - Wenchen Fan * - Hyukjin K

Re: [DISCUSS] SPARK-51318: Remove `jar` files from Apache Spark repository and disable affected tests

2025-02-26 Thread Sean Owen
The gist of the initial 2018 thread was: These are not source .jar files that users use, but .jar files used to test loading of from .jar files. These are test resources only. I don't think this is what the spirit of the rule is speaking to, that the end-user code should always have source code, wh

Re: [DISCUSS] SPARK-51318: Remove `jar` files from Apache Spark repository and disable affected tests

2025-02-26 Thread Dongjoon Hyun
Thank you for your reply, Sean. I expected that argument exactly so that I started by quoting your sentence in the above. I understood the reasoning in 2018. However, there are two reasons why I brought this again in 2025: First, the open source sprit is technically and literally "no compiled

unsubscribe

2025-02-26 Thread Tình Trần

Re: [VOTE] Release Spark 3.5.5 (RC1)

2025-02-26 Thread Rozov, Vlad
-0 (non-binding). IMO, it will be good to address https://issues.apache.org/jira/browse/SPARK-51318 to avoid legal issues and meet ASF source release policy. Thank you, Vlad On Feb 25, 2025, at 2:51 AM, Kent Yao wrote: +1 Kent On 2025/02/25 10:26:38 Max Gekk wrote: +1, since SPARK-51281 i

Re: [VOTE] Release Spark 3.5.5 (RC1)

2025-02-26 Thread Dongjoon Hyun
Thank you for the explicit casting, Vlad. BTW, the Apache Spark 3.5.5 RC1 vote will continue like all the previous Apache Spark RC votes because there is no agreement on those test resources (jar files) among Apache Spark PMC members. The following discussion thread will lead us subsequent comm

Re: [VOTE] Release Spark 3.5.5 (RC1)

2025-02-26 Thread Sakthi
+1 (non-binding) On Wed, Feb 26, 2025 at 9:20 AM Dongjoon Hyun wrote: > Thank you for the explicit casting, Vlad. > > BTW, the Apache Spark 3.5.5 RC1 vote will continue like all the previous > Apache Spark RC votes because there is no agreement on those test resources > (jar files) among Apache

Re: [VOTE] Release Spark 3.5.5 (RC1)

2025-02-26 Thread Chris Nauroth
+1 (non-binding) * Verified all checksums. * Verified all signatures. * Built from source, with multiple profiles, to full success: * build/mvn -T 8 -Phadoop-cloud -Phive-thriftserver -Pkubernetes -Pyarn -DskipTests clean package * Tests passed. * Ran several examples successfully: * bin/s

Re: [VOTE] Release Spark 3.5.5 (RC1)

2025-02-26 Thread Cheng Pan
+1 (non-binding) Pass integration tests with Apache Kyuubi. Thanks, Cheng Pan > On Feb 27, 2025, at 14:04, Chris Nauroth wrote: > > +1 (non-binding) > > * Verified all checksums. > * Verified all signatures. > * Built from source, with multiple profiles, to full success: > * build/mvn -