Hi, All. Apache Spark 4.1.0 RC1 vote is scheduled for November 23th.
To enable wide-scale community testing of the upcoming Spark 4.1 release, the Apache Spark community has posted a Spark 4.1.0-preview4 release. This preview is not a stable release in terms of either API or functionality, but it is the last preview to give the community early access to try the code that will become Spark 4.1 very soon. If you would like to test the release, please download it, and send feedback using either the mailing lists or JIRA. There are a lot of exciting new features added to Spark 4.1 including - New Data Types (GEOGRAPHY, GEOMETRY, TIME) - Constraints in DSv2 - Declarative Pipelines - Structured Streaming Real-Time Mode - JDBC Driver for Spark Connect - Python 3.14 Support and UDF/TDTF/Pandas Improvements - Support schema evolution with MERGE INTO statement - Improved Netty usage patterns with AUTO mode - Improved K8s support - Improved Spark Core features (Event Log, History Server, and Web UI) We'd like to thank our contributors and users for their contributions and early feedback to this release. This release would not have been possible without you. To download Spark 4.1.0-preview4, head over to the download page: https://dist.apache.org/repos/dist/release/spark/spark-4.1.0-preview4/ To view the documentation: https://spark.apache.org/docs/preview/ Best regards, Dongjoon Hyun
