+1. Parquet 1.15.2 has a data issue when reading files created with Parquet 1.13 or earlier using bloom filters. More details: https://github.com/apache/parquet-java/pull/3250 We could wait for a new Parquet version, but since this is a preview release, we can proceed with the release.
On Sat, Jul 12, 2025 at 3:13 AM Szehon Ho <szehon.apa...@gmail.com> wrote: > +1 (non-binding) > > Checked signature, checksum, basic functionality of > spark-4.1.0-preview1-bin-hadoop3 > > Thanks for setting this up ! > Szehon > > On Thu, Jul 10, 2025 at 11:18 PM Yang Jie <yangji...@apache.org> wrote: > >> +1 >> >> On 2025/07/11 04:23:27 Ángel Álvarez Pascua wrote: >> > +1 (non-binding) >> > >> > El jue, 10 jul 2025, 21:07, Jules Damji <jules.da...@gmail.com> >> escribió: >> > >> > > +1 (non-binding) >> > > — >> > > Sent from my iPhone >> > > Pardon the dumb thumb typos :) >> > > >> > > On Jul 10, 2025, at 8:04 AM, Peter Toth <peter.t...@gmail.com> wrote: >> > > >> > > >> > > +1 >> > > >> > > On Thu, Jul 10, 2025 at 9:12 AM Kent Yao <y...@apache.org> wrote: >> > > >> > >> Thank you all for the verification, +1 >> > >> >> > >> Kent >> > >> >> > >> 在 2025年7月10日星期四，Hyukjin Kwon <gurwls...@apache.org> 写道： >> > >> >> > >>> It was a mistake in the email. The artifact shouldn't have a >> problem. >> > >>> >> > >>> On Thu, 10 Jul 2025 at 16:00, Hyukjin Kwon <gurwls...@apache.org> >> wrote: >> > >>> >> > >>>> oh yeah. I think I should change the email contents. >> > >>>> >> > >>>> On Thu, 10 Jul 2025 at 15:02, Saruta, Kousuke >> > >>>> <saru...@amazon.co.jp.invalid> wrote: >> > >>>> >> > >>>>> Using dev1 rather than preview1 seems intended. >> > >>>>> >> > >>>>> >> > >>>>> >> https://github.com/apache/spark/blob/v4.1.0-preview1-rc1/dev/create-release/release-build.sh#L127 >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> *送信元**: *Jungtaek Lim <kabhwan.opensou...@gmail.com> >> > >>>>> *日付**: *2025年7月10日 木曜日 14:30 >> > >>>>> *宛先**: *Kent Yao <y...@apache.org> >> > >>>>> *Cc: *Anton Okolnychyi <aokolnyc...@gmail.com>, Max Gekk < >> > >>>>> max.g...@gmail.com>, Sandy Ryza <sa...@databricks.com.invalid>, >> > >>>>> Wenchen Fan <cloud0...@gmail.com>, Kousuke Saruta < >> saru...@apache.org>, >> > >>>>> "dev@spark.apache.org" <dev@spark.apache.org> >> > >>>>> *件名**: *RE: [EXTERNAL] [VOTE] Release Spark 4.1.0-preview1 (RC1) >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> *CAUTION*: This email originated from outside of the >> organization. Do >> > >>>>> not click links or open attachments unless you can confirm the >> sender and >> > >>>>> know the content is safe. >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> I think we used "dev1" for 4.0.0 "preview1" as well. I guess this >> is >> > >>>>> based on the name convention on python? >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> On Thu, Jul 10, 2025 at 1:07 PM Kent Yao <y...@apache.org> wrote: >> > >>>>> >> > >>>>> -1, >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> There is a 404 for >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/pyspark-4.1.0-preview1.tar.gz >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> pip install >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/pyspark-4.1.0-preview1.tar.gz >> > >>>>> Collecting >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/pyspark-4.1.0-preview1.tar.gz >> > >>>>> ERROR: HTTP error 404 while getting >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/pyspark-4.1.0-preview1.tar.gz >> > >>>>> ERROR: Could not install requirement >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/pyspark-4.1.0-preview1.tar.gz >> > >>>>> because of HTTP error 404 Client Error: Not Found for url: >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/pyspark-4.1.0-preview1.tar.gz >> > >>>>> for URL >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/pyspark-4.1.0-preview1.tar.gz >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> Can you check? >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> Kent >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> Jungtaek Lim <kabhwan.opensou...@gmail.com> 于2025年7月10日周四 >> 07:58写道： >> > >>>>> >> > >>>>> +1 (non-binding) Let's give it a try! >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> On Thu, Jul 10, 2025 at 12:24 AM Anton Okolnychyi < >> > >>>>> aokolnyc...@gmail.com> wrote: >> > >>>>> >> > >>>>> +1 (non-binding) >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> On Wed, Jul 9, 2025 at 8:07 AM Max Gekk <max.g...@gmail.com> >> wrote: >> > >>>>> >> > >>>>> +1 >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> On Wed, Jul 9, 2025 at 4:04 PM Sandy Ryza >> > >>>>> <sa...@databricks.com.invalid> wrote: >> > >>>>> >> > >>>>> +1 (non-binding) >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> On Wed, Jul 9, 2025 at 6:57 AM Wenchen Fan <cloud0...@gmail.com> >> > >>>>> wrote: >> > >>>>> >> > >>>>> +1 >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> On Wed, Jul 9, 2025 at 1:16 AM Kousuke Saruta <saru...@apache.org >> > >> > >>>>> wrote: >> > >>>>> >> > >>>>> +1 >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> 2025年7月9日(水) 2:12 Rozov, Vlad <vro...@amazon.com.invalid>: >> > >>>>> >> > >>>>> +1 (non-binding) >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> Thank you, >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> Vlad >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> *From: *Dongjoon Hyun <dongjoon.h...@gmail.com> >> > >>>>> *Date: *Tuesday, July 8, 2025 at 8:09 AM >> > >>>>> *To: *Hyukjin Kwon <gurwls...@apache.org> >> > >>>>> *Cc: *"dev@spark.apache.org" <dev@spark.apache.org> >> > >>>>> *Subject: *RE: [EXTERNAL] [VOTE] Release Spark 4.1.0-preview1 >> (RC1) >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> +1 >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> Dongjoon >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> On Tue, Jul 8, 2025 at 05:41 Hyukjin Kwon <gurwls...@apache.org> >> > >>>>> wrote: >> > >>>>> >> > >>>>> Alright. +1 from myself :-). >> > >>>>> >> > >>>>> >> > >>>>> >> > >>>>> On Tue, Jul 8, 2025 at 9:39 PM <gurwls...@apache.org> wrote: >> > >>>>> >> > >>>>> Please vote on releasing the following candidate as Apache Spark >> > >>>>> version 4.1.0-preview1. >> > >>>>> >> > >>>>> The vote is open until Sat, 12 Jul 2025 05:38:35 PDT and passes >> if a >> > >>>>> majority +1 PMC votes are cast, with >> > >>>>> a minimum of 3 +1 votes. >> > >>>>> >> > >>>>> [ ] +1 Release this package as Apache Spark 4.1.0-preview1 >> > >>>>> [ ] -1 Do not release this package because ... >> > >>>>> >> > >>>>> To learn more about Apache Spark, please see >> https://spark.apache.org/ >> > >>>>> >> > >>>>> The tag to be voted on is v4.1.0-preview1-rc1 (commit >> f3ac67ee9b3): >> > >>>>> https://github.com/apache/spark/tree/v4.1.0-preview1-rc1 >> > >>>>> >> > >>>>> The release files, including signatures, digests, etc. can be >> found at: >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/ >> > >>>>> >> > >>>>> Signatures used for Spark RCs can be found in this file: >> > >>>>> https://downloads.apache.org/spark/KEYS >> > >>>>> >> > >>>>> The staging repository for this release can be found at: >> > >>>>> >> https://repository.apache.org/content/repositories/orgapachespark-1500/ >> > >>>>> >> > >>>>> The documentation corresponding to this release can be found at: >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-docs/ >> > >>>>> >> > >>>>> The list of bug fixes going into 4.1.0-preview1 can be found at >> the >> > >>>>> following URL: >> > >>>>> https://issues.apache.org/jira/projects/SPARK/versions/12355581 >> > >>>>> >> > >>>>> FAQ >> > >>>>> >> > >>>>> ========================= >> > >>>>> How can I help test this release? >> > >>>>> ========================= >> > >>>>> >> > >>>>> If you are a Spark user, you can help us test this release by >> taking >> > >>>>> an existing Spark workload and running on this release candidate, >> then >> > >>>>> reporting any regressions. >> > >>>>> >> > >>>>> If you're working in PySpark you can set up a virtual env and >> install >> > >>>>> the current RC via "pip install >> > >>>>> >> https://dist.apache.org/repos/dist/dev/spark/v4.1.0-preview1-rc1-bin/pyspark-4.1.0-preview1.tar.gz >> > >>>>> " >> > >>>>> and see if anything important breaks. >> > >>>>> In the Java/Scala, you can add the staging repository to your >> > >>>>> project's resolvers and test >> > >>>>> with the RC (make sure to clean up the artifact cache >> before/after so >> > >>>>> you don't end up building with an out of date RC going forward). >> > >>>>> >> > >>>>> >> --------------------------------------------------------------------- >> > >>>>> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> > >>>>> >> > >>>>> >> > >> >> --------------------------------------------------------------------- >> To unsubscribe e-mail: dev-unsubscr...@spark.apache.org >> >>
