Hi Adam, Thanks for reporting the issue. @Eric Marnadi <eric.marn...@databricks.com> has a PR for the fix here - https://github.com/apache/spark/pull/50924
@Wenchen Fan <cloud0...@gmail.com> - would be good to include this in 4.0 RC Thanks, Anish On Fri, May 16, 2025 at 8:05 AM Adam Binford <adam...@gmail.com> wrote: > I think I found a bug when trying to use the new StateStore source reading > from RocksDB. Not sure if it should be a blocker or not but I don't think > it currently can read RocksDB state store checkpoints. This was from RC2 or > RC3, but I don't see any relevant issues or fixes for this. Trying to test > out RC6 now. > > https://issues.apache.org/jira/browse/SPARK-52188 > > On Thu, May 15, 2025 at 3:32 AM Max Gekk <max.g...@gmail.com> wrote: > >> +1 >> >> On Thu, May 15, 2025 at 4:50 AM Kent Yao <y...@apache.org> wrote: >> >>> +1 >>> >>> Jules Damji <jules.da...@gmail.com> 于2025年5月15日周四 04:05写道： >>> >>>> +1 (non-binding) >>>> — >>>> Sent from my iPhone >>>> Pardon the dumb thumb typos :) >>>> >>>> On May 14, 2025, at 11:29 AM, Denny Lee <denny.g....@gmail.com> wrote: >>>> >>>> >>>> +1 (non-binding) >>>> >>>> On Wed, May 14, 2025 at 10:34 AM Chao Sun <sunc...@apache.org> wrote: >>>> >>>>> +1 >>>>> >>>>> On Wed, May 14, 2025 at 10:30 AM Holden Karau <holden.ka...@gmail.com> >>>>> wrote: >>>>> >>>>>> +1 >>>>>> >>>>>> On Wed, May 14, 2025 at 10:10 AM L. C. Hsieh <vii...@gmail.com> >>>>>> wrote: >>>>>> >>>>>>> +1 >>>>>>> >>>>>>> On Tue, May 13, 2025 at 3:28 PM Wenchen Fan <cloud0...@gmail.com> >>>>>>> wrote: >>>>>>> > >>>>>>> > Please vote on releasing the following candidate as Apache Spark >>>>>>> version 4.0.0. >>>>>>> > >>>>>>> > The vote is open until May 16 (PST) and passes if a majority +1 >>>>>>> PMC votes are cast, with a minimum of 3 +1 votes. >>>>>>> > >>>>>>> > [ ] +1 Release this package as Apache Spark 4.0.0 >>>>>>> > [ ] -1 Do not release this package because ... >>>>>>> > >>>>>>> > To learn more about Apache Spark, please see >>>>>>> https://spark.apache.org/ >>>>>>> > >>>>>>> > The tag to be voted on is v4.0.0-rc6 (commit >>>>>>> 9a99ecb03a2d35f5f38decd686b55511a5c7c535) >>>>>>> > https://github.com/apache/spark/tree/v4.0.0-rc6 >>>>>>> > >>>>>>> > The release files, including signatures, digests, etc. can be >>>>>>> found at: >>>>>>> > https://dist.apache.org/repos/dist/dev/spark/v4.0.0-rc6-bin/ >>>>>>> > >>>>>>> > Signatures used for Spark RCs can be found in this file: >>>>>>> > https://dist.apache.org/repos/dist/dev/spark/KEYS >>>>>>> > >>>>>>> > The staging repository for this release can be found at: >>>>>>> > >>>>>>> https://repository.apache.org/content/repositories/orgapachespark-1484/ >>>>>>> > >>>>>>> > The documentation corresponding to this release can be found at: >>>>>>> > https://dist.apache.org/repos/dist/dev/spark/v4.0.0-rc6-docs/ >>>>>>> > >>>>>>> > The list of bug fixes going into 4.0.0 can be found at the >>>>>>> following URL: >>>>>>> > https://issues.apache.org/jira/projects/SPARK/versions/12353359 >>>>>>> > >>>>>>> > This release is using the release script of the tag v4.0.0-rc6. >>>>>>> > >>>>>>> > FAQ >>>>>>> > >>>>>>> > ========================= >>>>>>> > How can I help test this release? >>>>>>> > ========================= >>>>>>> > >>>>>>> > If you are a Spark user, you can help us test this release by >>>>>>> taking >>>>>>> > an existing Spark workload and running on this release candidate, >>>>>>> then >>>>>>> > reporting any regressions. >>>>>>> > >>>>>>> > If you're working in PySpark you can set up a virtual env and >>>>>>> install >>>>>>> > the current RC and see if anything important breaks, in the >>>>>>> Java/Scala >>>>>>> > you can add the staging repository to your projects resolvers and >>>>>>> test >>>>>>> > with the RC (make sure to clean up the artifact cache before/after >>>>>>> so >>>>>>> > you don't end up building with a out of date RC going forward). >>>>>>> >>>>>>> --------------------------------------------------------------------- >>>>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >>>>>>> >>>>>>> >>>>>> >>>>>> -- >>>>>> Twitter: https://twitter.com/holdenkarau >>>>>> Fight Health Insurance: https://www.fighthealthinsurance.com/ >>>>>> <https://www.fighthealthinsurance.com/?q=hk_email> >>>>>> Books (Learning Spark, High Performance Spark, etc.): >>>>>> https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> >>>>>> YouTube Live Streams: https://www.youtube.com/user/holdenkarau >>>>>> Pronouns: she/her >>>>>> >>>>> > > -- > Adam Binford >
