Re: Dynamic resource allocation for structured streaming [SPARK-24815]

2023-08-19 Thread Pavan Kotikalapudi
IMO ML might be good for cluster scheduler but for the core DRA algorithm of SSS I believe we should start with some primitives of Structured streaming. I would love to get some reviews on the doc and opinions on the feasibility of the solution. We have seen quite some savings using this solution

Re: [VOTE] Release Apache Spark 3.5.0 (RC2)

2023-08-19 Thread Sean Owen
+1 this looks better to me. Works with Scala 2.13 / Java 17 for me. On Sat, Aug 19, 2023 at 3:23 AM Yuanjian Li wrote: > Please vote on releasing the following candidate(RC2) as Apache Spark > version 3.5.0. > > The vote is open until 11:59pm Pacific time Aug 23th and passes if a > majority +1 P

[VOTE] Release Apache Spark 3.5.0 (RC2)

2023-08-19 Thread Yuanjian Li
Please vote on releasing the following candidate(RC2) as Apache Spark version 3.5.0. The vote is open until 11:59pm Pacific time Aug 23th and passes if a majority +1 PMC votes are cast, with a minimum of 3 +1 votes. [ ] +1 Release this package as Apache Spark 3.5.0 [ ] -1 Do not release this pac