Thanks for doing this! I'd love to review these. I'm not an expert in Spark but i have some historical context and understanding of the SparkRunner codebase. Feel free to ping me any time if I take too long to get to one. Sometimes I lose track of things :-)
Kenn On Wed, Dec 4, 2024 at 9:50 AM LDesire <two_som...@icloud.com> wrote: > Hi Beam Dev Community, > > I've made some updates to Spark Runner in Apache Beam. The updates are in > these PRs: > > - #33212 <https://github.com/apache/beam/pull/33212>: Added > OrderedListState support for SparkRunner > - #33267 <https://github.com/apache/beam/pull/33267>: Added support for > SparkRunner streaming stateful processing > > These changes include significant improvements to Spark Runner's state > management capabilities, implementing OrderedListState support and adding > streaming stateful processing functionality. > > Please review if you know the Beam Spark Runner or someone who might be > interested. > Thank you for your time and contributions! > > Best regards >
