Thanks all! The two reported issues are both fixed, and I'll cut the next RC on my Monday next week.
On Sat, May 17, 2025 at 4:17 AM Jungtaek Lim <kabhwan.opensou...@gmail.com> wrote: > UPDATE: The fix is merged. @Adam Binford <adam...@gmail.com> if you could > help verifying this in latest branch-4.0, that would be great. Thanks for > reporting the issue! > > On Sat, May 17, 2025 at 3:05 AM Anish Shrigondekar > <anish.shrigonde...@databricks.com.invalid> wrote: > >> Hi Adam, >> >> Thanks for reporting the issue. @Eric Marnadi >> <eric.marn...@databricks.com> has a PR for the fix here - >> https://github.com/apache/spark/pull/50924 >> >> @Wenchen Fan <cloud0...@gmail.com> - would be good to include this in >> 4.0 RC >> >> Thanks, >> Anish >> >> On Fri, May 16, 2025 at 8:05 AM Adam Binford <adam...@gmail.com> wrote: >> >>> I think I found a bug when trying to use the new StateStore source >>> reading from RocksDB. Not sure if it should be a blocker or not but I don't >>> think it currently can read RocksDB state store checkpoints. This was from >>> RC2 or RC3, but I don't see any relevant issues or fixes for this. Trying >>> to test out RC6 now. >>> >>> https://issues.apache.org/jira/browse/SPARK-52188 >>> >>> On Thu, May 15, 2025 at 3:32 AM Max Gekk <max.g...@gmail.com> wrote: >>> >>>> +1 >>>> >>>> On Thu, May 15, 2025 at 4:50 AM Kent Yao <y...@apache.org> wrote: >>>> >>>>> +1 >>>>> >>>>> Jules Damji <jules.da...@gmail.com> 于2025年5月15日周四 04:05写道： >>>>> >>>>>> +1 (non-binding) >>>>>> — >>>>>> Sent from my iPhone >>>>>> Pardon the dumb thumb typos :) >>>>>> >>>>>> On May 14, 2025, at 11:29 AM, Denny Lee <denny.g....@gmail.com> >>>>>> wrote: >>>>>> >>>>>> >>>>>> +1 (non-binding) >>>>>> >>>>>> On Wed, May 14, 2025 at 10:34 AM Chao Sun <sunc...@apache.org> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> On Wed, May 14, 2025 at 10:30 AM Holden Karau < >>>>>>> holden.ka...@gmail.com> wrote: >>>>>>> >>>>>>>> +1 >>>>>>>> >>>>>>>> On Wed, May 14, 2025 at 10:10 AM L. C. Hsieh <vii...@gmail.com> >>>>>>>> wrote: >>>>>>>> >>>>>>>>> +1 >>>>>>>>> >>>>>>>>> On Tue, May 13, 2025 at 3:28 PM Wenchen Fan <cloud0...@gmail.com> >>>>>>>>> wrote: >>>>>>>>> > >>>>>>>>> > Please vote on releasing the following candidate as Apache Spark >>>>>>>>> version 4.0.0. >>>>>>>>> > >>>>>>>>> > The vote is open until May 16 (PST) and passes if a majority +1 >>>>>>>>> PMC votes are cast, with a minimum of 3 +1 votes. >>>>>>>>> > >>>>>>>>> > [ ] +1 Release this package as Apache Spark 4.0.0 >>>>>>>>> > [ ] -1 Do not release this package because ... >>>>>>>>> > >>>>>>>>> > To learn more about Apache Spark, please see >>>>>>>>> https://spark.apache.org/ >>>>>>>>> > >>>>>>>>> > The tag to be voted on is v4.0.0-rc6 (commit >>>>>>>>> 9a99ecb03a2d35f5f38decd686b55511a5c7c535) >>>>>>>>> > https://github.com/apache/spark/tree/v4.0.0-rc6 >>>>>>>>> > >>>>>>>>> > The release files, including signatures, digests, etc. can be >>>>>>>>> found at: >>>>>>>>> > https://dist.apache.org/repos/dist/dev/spark/v4.0.0-rc6-bin/ >>>>>>>>> > >>>>>>>>> > Signatures used for Spark RCs can be found in this file: >>>>>>>>> > https://dist.apache.org/repos/dist/dev/spark/KEYS >>>>>>>>> > >>>>>>>>> > The staging repository for this release can be found at: >>>>>>>>> > >>>>>>>>> https://repository.apache.org/content/repositories/orgapachespark-1484/ >>>>>>>>> > >>>>>>>>> > The documentation corresponding to this release can be found at: >>>>>>>>> > https://dist.apache.org/repos/dist/dev/spark/v4.0.0-rc6-docs/ >>>>>>>>> > >>>>>>>>> > The list of bug fixes going into 4.0.0 can be found at the >>>>>>>>> following URL: >>>>>>>>> > https://issues.apache.org/jira/projects/SPARK/versions/12353359 >>>>>>>>> > >>>>>>>>> > This release is using the release script of the tag v4.0.0-rc6. >>>>>>>>> > >>>>>>>>> > FAQ >>>>>>>>> > >>>>>>>>> > ========================= >>>>>>>>> > How can I help test this release? >>>>>>>>> > ========================= >>>>>>>>> > >>>>>>>>> > If you are a Spark user, you can help us test this release by >>>>>>>>> taking >>>>>>>>> > an existing Spark workload and running on this release >>>>>>>>> candidate, then >>>>>>>>> > reporting any regressions. >>>>>>>>> > >>>>>>>>> > If you're working in PySpark you can set up a virtual env and >>>>>>>>> install >>>>>>>>> > the current RC and see if anything important breaks, in the >>>>>>>>> Java/Scala >>>>>>>>> > you can add the staging repository to your projects resolvers >>>>>>>>> and test >>>>>>>>> > with the RC (make sure to clean up the artifact cache >>>>>>>>> before/after so >>>>>>>>> > you don't end up building with a out of date RC going forward). >>>>>>>>> >>>>>>>>> >>>>>>>>> --------------------------------------------------------------------- >>>>>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Twitter: https://twitter.com/holdenkarau >>>>>>>> Fight Health Insurance: https://www.fighthealthinsurance.com/ >>>>>>>> <https://www.fighthealthinsurance.com/?q=hk_email> >>>>>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>>>>> Pronouns: she/her >>>>>>>> >>>>>>> >>> >>> -- >>> Adam Binford >>> >>
