Re: [DISCUSS] Dropping LevelDB support in Spark

I would like to provide some new information: 1. Spark 3.4.0 [SPARK-42277] has started using RocksDB as the default option for `spark.history.store.hybridStore.diskBackend`. - Since Spark 3.4, Spark will use RocksDB store if `spark.history.store.hybridStore.enabled` is true. To restore the beha

Re: [VOTE] Release Apache Spark Connect Go Client 0.1.0

The release artifacts don’t satisfy the ASF release policy[1]. > Projects MUST direct outsiders towards official releases rather than raw > source repositories, nightly builds, snapshots, release candidates, or any > other similar packages. > Every ASF release MUST contain one or more source pa

Re: [VOTE] Release Apache Spark Connect Go Client 0.1.0

+1 On Sun, Jun 8, 2025 at 21:40 Jules Damji wrote: > +1 (non-binding? > — > Sent from my iPhone > Pardon the dumb thumb typos :) > > On Jun 8, 2025, at 9:32 PM, Hyukjin Kwon wrote: > >  > > +1 > > On Sun, Jun 8, 2025 at 9:22 PM Martin Grund > wrote: > >> Please vote on releasing the following

Re: [VOTE] Release Apache Spark Connect Go Client 0.1.0

+1 (non-binding? —Sent from my iPhonePardon the dumb thumb typos :)On Jun 8, 2025, at 9:32 PM, Hyukjin Kwon wrote:+1On Sun, Jun 8, 2025 at 9:22 PM Martin Grund wrote:Please vote on releasing the following candidate as Apache Spark Connect Go Client 0.1.0. The release candidate was tested and bui

Re: [VOTE] Release Apache Spark Connect Go Client 0.1.0

+1 On Sun, Jun 8, 2025 at 9:22 PM Martin Grund wrote: > Please vote on releasing the following candidate as Apache Spark Connect > Go Client 0.1.0. > > The release candidate was tested and built against Spark 4.0.0. The > repository contains a sample application for submitting jobs written in Go

[VOTE] Release Apache Spark Connect Go Client 0.1.0

Please vote on releasing the following candidate as Apache Spark Connect Go Client 0.1.0. The release candidate was tested and built against Spark 4.0.0. The repository contains a sample application for submitting jobs written in Go using a small JVM wrapper

Re: [DISCUSS] Dropping LevelDB support in Spark

Thanks for the valuable input. I think it's more about the case where upgrading would surprise the end users. If we simply remove LevelDB from the next release, we will be removing these intermediate data as well and enforcing them to rebuild everything. 15 mins is probably not super long from the

Re: [DISCUSS] Automation of RC email

I am working on it at https://github.com/apache/spark/pull/51122. Some emails might be sent for RC 3.5.7 for testing purposes. Please ignore them :-). I will reply to individual email as well to avoid confusion. On Thu, 5 Jun 2025 at 20:07, Yang Jie wrote: > Option 1 +1, thank you, Hyukjin, for