Re: [ANNOUNCE] Announcing Apache Spark 3.1.1

Congrats, all! Bests, Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark

Re: [VOTE] SPIP: Add FunctionCatalog

+1, looks great! Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi

Re: [VOTE] Release Spark 2.4.8 (RC2)

+1 (non-binding) Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

Cool~Thanks, Hyukjin Yuanjian Li 于2021年4月14日周三 下午3:39写道： > Awesome! Thanks for making this happen, Hyukjin! > > Yi Wu 于2021年4月14日周三 下午2:51写道： > >> Thanks for the great work, Hyukjin! >> >> On Wed, Apr 14, 2021 at 1:00 PM Gengliang Wang wrote: >> >>> Thanks for the amazing work, Hyukjin! >>> I

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

to keep up with the current master branch？ Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant JDBC interface for large-scale d

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

Cool, thanks! Hyukjin Kwon 于2021年4月14日周三 下午8:19写道： > Good point! I had to clarify. > Once is enough. The sync is needed for your branch to include the changes > of https://github.com/apache/spark/pull/32092. > > > 2021년 4월 14일 (수) 오후 9:11, Kent Yao 님이 작성: > >> Hi H

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

11:34写道： > > Thank you again, Hyukjin. > > Bests, > Dongjoon. > > On Wed, Apr 14, 2021 at 5:25 AM Kent Yao wrote: >> >> Cool, thanks! >> >> Hyukjin Kwon 于2021年4月14日周三 下午8:19写道： >>> >>> Good point! I had to clarify. >>> O

Re: [PSA] Please read: PR builder now runs test and build in your forked repository

nks Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant JDBC interface for large-scale d

Re: [VOTE] Release Spark 2.4.8 (RC3)

gt; Version/s" = 2.4.8 >>> >>> Committers should look at those and triage. Extremely important bug >>> fixes, documentation, and API tweaks that impact compatibility should >>> be worked on immediately. Everything else please retarget to an >>>

Re: [VOTE] Release Spark 2.4.8 (RC4)

+1 (non-binding) Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified

Re: Apache Spark 3.1.2 Release?

+1. thanks Dongjoon Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified

Re: Resolves too old JIRAs as incomplete

+1，thanks Takeshi Kent Yao  @ Data Science Center, Hangzhou Research Institute, NetEase Corp. a spark enthusiast kyuubiis a unified multi-tenant JDBC interface for large-scale data processing and analytics, built on top of Apache Spark. spark-authorizerA Spark SQL extension which provides SQL

Re: [VOTE] Release Spark 3.1.2 (RC1)

+1, non-binding Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi

Re: Apache Spark 3.0.3 Release?

+1. Thanks, Yi ~ Bests, Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a

Re: [VOTE] Release Spark 3.0.3 (RC1)

+1 (non-binding) Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark

Re:Time to start publishing Spark Docker Images?

+1Bests, Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant

Re: [VOTE] Release Spark 3.2.0 (RC7)

; } font{ line-height: 1.6; } Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiasthttps://github.com/yaooqinn/kyuubi"; style="box-sizing: border-box;">kyuubiis a unified multi-tenant J

Re: [VOTE] Release Spark 3.2.1 (RC1)

+1 (non-binding). Chao Sun 于2022年1月12日周三 16:10写道： > +1 (non-binding). Thanks Huaxin for driving the release! > > On Tue, Jan 11, 2022 at 11:56 PM Ruifeng Zheng > wrote: > >> +1 (non-binding) >> >> Thanks, ruifeng zheng >> >> -- Original -- >> *From:* "Cheng Su" ;

Re: [VOTE][SPIP] Support Customized Kubernetes Schedulers Proposal

+1 (non-binding) Thomas Graves 于2022年1月12日周三 11:52写道： > +1 (binding). > > One minor note since I haven't had time to look at the implementation > details is please make sure resource aware scheduling and the stage > level scheduling still work or any caveats are documented. Feel free > to ping m

Re: [VOTE] Release Spark 3.2.1 (RC2)

+1， non-binding John Zhuge 于2022年1月25日周二 06:56写道： > +1 (non-binding) > > On Mon, Jan 24, 2022 at 2:28 PM Cheng Su wrote: > >> +1 (non-binding) >> >> >> >> Cheng Su >> >> >> >> *From: *Chao Sun >> *Date: *Monday, January 24, 2022 at 2:10 PM >> *To: *Michael Heuer >> *Cc: *dev >> *Subject: *Re

Re: [VOTE] Release Spark 3.3.0 (RC2)

eRowRelation Both 3.2 releases and the master branch work fine with correct errors - 'due to data type mismatch'. Shall we backport the fix from the master to 3.3 too? Bests Kent Yao Yuming Wang 于2022年5月18日周三 19:04写道： > > -1. There is a regression: https://github.com/apache/sp

Re: [VOTE] Release Spark 3.3.0 (RC2)

Thanks, Maxim. Leave my -1 for this release candidate. Unfortunately, I don't know which PR fixed this. Does anyone happen to know? BR, Kent Yao Maxim Gekk 于2022年5月19日周四 13:42写道： > > Hi Kent, > > > Shall we backport the fix from the master to 3.3 too? > > Yes

Re: [VOTE] Release Spark 3.3.0 (RC2)

Wenchen Fan wrote: >> >> I think it should have been fixed by >> https://github.com/apache/spark/commit/0fdb6757946e2a0991256a3b73c0c09d6e764eed >> . Maybe the fix is not completed... >> >> On Thu, May 19, 2022 at 2:16 PM Kent Yao wrote: >&g

Re: 回复： [VOTE] Release Spark 3.3.0 (RC6)

+1, non-binding Xiao Li 于2022年6月14日周二 13:11写道： > > +1 > > Xiao > > beliefer 于2022年6月13日周一 20:04写道： >> >> +1 AFAIK, no blocking issues now. >> Glad to hear to release 3.3.0 ! >> >> >> 在 2022-06-14 09:38:35，"Ruifeng Zheng" 写道： >> >> +1 (non-binding) >> >> Maxim, thank you for driving this release

Re: [DISCUSS] SPIP: Support Docker Official Image for Spark

+1 Gengliang Wang 于2022年9月19日周一 09:23写道： > > +1, thanks for the work! > > On Sun, Sep 18, 2022 at 6:20 PM Hyukjin Kwon wrote: >> >> +1 >> >> On Mon, 19 Sept 2022 at 09:15, Yikun Jiang wrote: >>> >>> Hi, all >>> >>> >>> I would like to start the discussion for supporting Docker Official Image >

Re: [VOTE] SPIP: Support Docker Official Image for Spark

+1 Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant JDBC

Re: [VOTE][SPIP] Better Spark UI scalability and Driver stability for large applications

+1, non-binding Gengliang Wang 于2022年11月16日周三 16:36写道： > > Hi all, > > I’d like to start a vote for SPIP: "Better Spark UI scalability and Driver > stability for large applications" > > The goal of the SPIP is to improve the Driver's stability by supporting > storing Spark's UI data on RocksDB.

Re: [VOTE] Release Apache Spark 3.4.0 (RC7)

+1(non-binding) Gengliang Wang 于2023年4月10日周一 15:27写道： > > +1 > > On Sun, Apr 9, 2023 at 3:17 PM Dongjoon Hyun wrote: >> >> +1 >> >> I verified the same steps like previous RCs. >> >> Dongjoon. >> >> >> On Sat, Apr 8, 2023 at 7:47 PM Mridul Muralidharan wrote: >>> >>> >>> +1 >>> >>> Signatures,

Re: [VOTE] Release Apache Spark 3.2.4 (RC1)

+1 (non-binding) L. C. Hsieh 于2023年4月10日周一 15:02写道： > > +1 > > Thanks Dongjoon > > On Sun, Apr 9, 2023 at 5:20 PM Dongjoon Hyun wrote: > > > > I'll start with my +1. > > > > I verified the checksum, signatures of the artifacts, and documentations. > > Also, ran the tests with YARN and K8s module

Re: Time for Spark v3.5.0 release

+1， thank you Kent On 2023/07/04 05:32:52 Dongjoon Hyun wrote: > +1 > > Thank you, Yuanjian > > Dongjoon > > On Tue, Jul 4, 2023 at 1:03 AM Hyukjin Kwon wrote: > > > Yeah one day postponed shouldn't be a big deal. > > > > On Tue, Jul 4, 2023 at 7:10 AM Yuanjian Li wrote: > > > >> Hi All, >

Re: Spark Docker Official Image is now available

Thank you, Yikun! Kent Dongjoon Hyun 于2023年7月20日周四 19:25写道： > Thank you! > > Dongjoon > > On Thu, Jul 20, 2023 at 8:40 AM Xiao Li > wrote: > >> Thank you, Yikun! This is great! >> >> On Wed, Jul 19, 2023 at 7:55 PM Ruifeng Zheng wrote: >> >>> Awesome, thank you YiKun for driving this! >>> >>

Re: Welcome two new Apache Spark committers

Congrats! Peter and Xiduo! Cheng Pan 于2023年8月7日周一 11:01写道： > > Congratulations! Peter and Xiduo! > > Thanks, > Cheng Pan > > > > On Aug 7, 2023, at 10:58, Gengliang Wang wrote: > > > > Congratulations! Peter and Xiduo! > > > > -

Re: [VOTE] Release Apache Spark 3.5.0 (RC4)

+1 (Non-binding) Kent Gengliang Wang 于2023年9月7日周四 14:09写道： > > +1 > > On Wed, Sep 6, 2023 at 9:46 PM Yuanjian Li wrote: >> >> +1 (non-binding) >> >> Xiao Li 于2023年9月6日周三 15:27写道： >>> >>> +1 >>> >>> Xiao >>> >>> Herman van Hovell 于2023年9月6日周三 22:08写道： Tested connect, and everything l

Re: [VOTE] Release Apache Spark 3.5.0 (RC5)

+1 (non-binding), great work! Kent Yao Yuming Wang 于2023年9月12日周二 11:32写道： > > +1. > > On Tue, Sep 12, 2023 at 10:57 AM yangjie01 > wrote: >> >> +1 >> >> >> >> 发件人: Jia Fan >> 日期: 2023年9月12日 星期二 10:08 >> 收件人: Ruifeng Zheng >&

Re: Welcome to Our New Apache Spark Committer and PMCs

Congrats! Kent 在 2023年10月7日星期六，John Zhuge 写道： > Congratulations! > > On Fri, Oct 6, 2023 at 6:41 PM Yi Wu wrote: > >> Congrats! >> >> On Sat, Oct 7, 2023 at 9:24 AM XiDuo You wrote: >> >>> Congratulations! >>> >>> Prashant Sharma 于2023年10月6日周五 00:26写道： >>> > >>> > Congratulations 🎉 >>> > >>

Re: Apache Spark 3.4.2 (?)

+1 Maxim Gekk 于2023年11月9日周四 18:18写道： > > +1 > > On Wed, Nov 8, 2023 at 5:29 AM kazuyuki tanimura > wrote: >> >> +1 >> >> Kazu >> >> On Nov 7, 2023, at 5:23 PM, L. C. Hsieh wrote: >> >> +1 >> >> On Tue, Nov 7, 2023 at 4:56 PM Dongjoon Hyun wrote: >> >> >> Thank you all! >> >> Dongjoon >> >> On

[DISCUSS] SPIP: Testing Framework for Spark UI Javascript files

. Thanks, Kent Yao [1] https://docs.google.com/document/d/1hWl5Q2CNNOjN5Ubyoa28XmpJtDyD9BtGtiEG2TT94rg/edit?usp=sharing [2] https://github.com/jestjs/jest [3] https://github.com/apache/spark/pull/43903 - To unsubscribe e-mail

Re: [DISCUSS] SPIP: Testing Framework for Spark UI Javascript files

posing a new UI test framework for Apache Spark 4.0. > > > > It looks very useful. > > > > Thanks, > > Dongjoon. > > > > > > On Tue, Nov 21, 2023 at 1:51 AM Kent Yao wrote: > > > >> Hi Spark Dev, > >> > >> This is a cal

[VOTE] SPIP: Testing Framework for Spark UI Javascript files

ccept the proposal as an official SPIP [ ] +0 [ ] -1: I don’t think this is a good idea because … Thank you! Kent Yao [1] https://lists.apache.org/thread/5rqrho4ldgmqlc173y2229pfll5sgkff [2] https://docs.google.com/document/d/1hWl5Q2CNNOjN5Ubyoa28XmpJtDyD9BtGtiEG2TT94rg/edit?usp=sh

Re: [VOTE] SPIP: Testing Framework for Spark UI Javascript files

023 at 6:58 AM Gengliang Wang wrote: > > > > > +1 > > > > > > On Sat, Nov 25, 2023 at 2:50 AM yangjie01 > > > wrote: > > > > > >> +1 > > >> > > >> > > >> > > >> *发件人**: *Reynold Xin &g

[RESULT][VOTE] SPIP: Testing Framework for Spark UI Javascript files

Hi Spark dev, The vote[1] has now closed. The results are: +1 Votes(*=binding): - Mridul Muralidharan* - Ye Zhou - Dongjoon Hyun* - Reynold Xin* - Yang Jie - Gengliang Wang* - Ruifeng Zheng* - Binjie Yang - Kent Yao 0 Votes: None -1 Votes: None The vote is successful with 5 binding +1 votes

Re: [VOTE] Release Spark 3.4.2 (RC1)

+1(non-binding) Kent Yao On 2023/11/27 01:12:53 Dongjoon Hyun wrote: > Hi, Marc. > > Given that it exists in 3.4.0 and 3.4.1, I don't think it's a release > blocker for Apache Spark 3.4.2. > > When the patch is ready, we can consider it for 3.4.3. > > In

Re: Apache Spark 3.3.4 EOL Release?

+1 Thank you for driving this EOL release, Dongjoon! Kent Yao On 2023/12/04 19:40:10 Mridul Muralidharan wrote: > +1 > > Regards, > Mridul > > On Mon, Dec 4, 2023 at 11:40 AM L. C. Hsieh wrote: > > > +1 > > > > Thanks Dongjoon! > > >

Re: [VOTE] Release Spark 3.3.4 (RC1)

+1(non-binding Kent Yao Yuming Wang 于2023年12月11日周一 09:33写道： > > +1 > > On Mon, Dec 11, 2023 at 5:55 AM Dongjoon Hyun wrote: >> >> +1 >> >> Dongjoon >> >> On 2023/12/08 21:41:00 Dongjoon Hyun wrote: >> > Please vote on releasing t

Re: [DISCUSS] Release Spark 3.5.1?

+1 Jungtaek Lim 于2024年2月3日周六 21:14写道： > > Hi dev, > > looks like there are a huge number of commits being pushed to branch-3.5 > after 3.5.0 was released, 200+ commits. > > $ git log --oneline v3.5.0..HEAD | wc -l > 202 > > Also, there are 180 JIRA tickets containing 3.5.1 as fixed version, and

Re: [DISCUSS] Support year-month and day-time Intervals

our proposal need to revert something from the master branch?I'm just asking because it's not clear in the proposal document.Bests,Dongjoon.On Fri, Jan 10, 2020 at 5:31 AM Dr. Kent Yao <yaooq...@qq.com> wrote:Hi, Devs I’d like to propose to add two new interval types which are year

Re: [Spark SQL]: SQL, Python, Scala and R API Consistency

really test most of the functions beyond the simple> "callability". One the complex ones, that require some non-trivial> transformations of arguments, are fully tested.> --> Best regards,> Maciej Szymkiewicz> Web: https://zero323.net> Keybase: https://keybas

Re: [VOTE] Release Spark 3.1.1 (RC1)

27;s behavior for tuning the IO performance w/ HDFS if there is an existing io.file.buffer.size in hive-site.xml Kent Yao @ Data Science Center, Hangzhou Research Institut

Re:[VOTE] Release Spark 3.1.1 (RC2)

+1 Kent Yao @ Data Science Center, Hangzhou Research Institute, NetEase Corp.a spark enthusiastkyuubiis a unified multi-tenant JDBC

Re: [VOTE] SPIP: Structured Logging Framework for Apache Spark

+1 (non-binding) Kent Yao Hyukjin Kwon 于2024年3月11日周一 17:26写道： > > +1 > > On Mon, 11 Mar 2024 at 18:11, yangjie01 wrote: >> >> +1 >> >> >> >> Jie Yang >> >> >> >> 发件人: Haejoon Lee >> 日期: 2024年3月11日 星期一 17:09

Re: [VOTE] SPIP: Pure Python Package in PyPI (Spark Connect)

+1(non-binding). Thank you, Hyukjin. Kent Yao Takuya UESHIN 于2024年4月1日周一 18:04写道： > > +1 > > On Sun, Mar 31, 2024 at 6:16 PM Hyukjin Kwon wrote: >> >> Hi all, >> >> I'd like to start the vote for SPIP: Pure Python Package in PyPI (Spark >&g

Re: Apache Spark 3.4.3 (?)

+1, thank you, Dongjoon Kent Holden Karau 于2024年4月7日周日 14:54写道： > > Sounds good to me :) > > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 > YouTube Live Streams: https://www.youtube.com/user/holdenkarau > > > On Sat, Ap

Re: [VOTE] Release Spark 3.4.3 (RC2)

+1(non-binding) Thanks, Kent Yao bo yang 于2024年4月17日周三 09:49写道： > > +1 > > On Tue, Apr 16, 2024 at 1:38 PM Hyukjin Kwon wrote: >> >> +1 >> >> On Wed, Apr 17, 2024 at 3:57 AM L. C. Hsieh wrote: >>> >>> +1 >>> >>> On Tue, A

Re: [DISCUSS] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

+1 Nit: the umbrella ticket is SPARK-44111, not SPARK-4. Thanks, Kent Yao Dongjoon Hyun 于2024年4月25日周四 14:39写道： > > Hi, All. > > It's great to see community activities to polish 4.0.0 more and more. > Thank you all. > > I'd like to bring SPARK-46122 (ano

Re: [FYI] SPARK-47993: Drop Python 3.8

+1 yangjie01 于2024年4月26日周五 17:16写道： > > +1 > > > > 发件人: Ruifeng Zheng > 日期: 2024年4月26日 星期五 15:05 > 收件人: Xinrong Meng > 抄送: Dongjoon Hyun , "dev@spark.apache.org" > > 主题: Re: [FYI] SPARK-47993: Drop Python 3.8 > > > > +1 > > > > On Fri, Apr 26, 2024 at 10:26 AM Xinrong Meng wrote: > > +1 > >

Re: [VOTE] SPARK-46122: Set spark.sql.legacy.createHiveTableByDefault to false

+1 Kent Yao On 2024/04/30 09:07:21 Yuming Wang wrote: > +1 > > On Tue, Apr 30, 2024 at 3:31 PM Ye Xianjin wrote: > > > +1 > > Sent from my iPhone > > > > On Apr 30, 2024, at 3:23 PM, DB Tsai wrote: > > > >  > > +1 > > > > On

Re: [VOTE] SPIP: Stored Procedures API for Catalogs

+1 Dongjoon Hyun 于2024年5月13日周一 08:39写道： > > +1 > > On Sun, May 12, 2024 at 3:50 PM huaxin gao wrote: >> >> +1 >> >> On Sat, May 11, 2024 at 4:35 PM L. C. Hsieh wrote: >>> >>> +1 >>> >>> On Sat, May 11, 2024 at 3:11 PM Chao Sun wrote: >>> > >>> > +1 >>> > >>> > On Sat, May 11, 2024 at 2:10 PM L

Re: [VOTE] SPARK 4.0.0-preview1 (RC2)

-1 You've updated your key in [2] with a new one [1]. I believe you should add your new key without removing the old one. Otherwise, users cannot verify those archived releases you published. Thanks, Kent Yao [1] https://dist.apache.org/repos/dist/dev/spark/KEYS [2]

Re: [VOTE] SPARK 4.0.0-preview1 (RC3)

necessary. Thanks, Kent Yao [1] jackson-core-asl-1.9.13.jar [2] jackson-mapper-asl-1.9.13.jar On 2024/05/28 18:52:32 Wenchen Fan wrote: > one correction: "The tag to be voted on is v4.0.0-preview1-rc2 (commit > 7cfe5a6e44e8d7079ae29ad3e2cee7231cd3dc66)" should be "The tag to be

Re: [外部邮件] Re: [VOTE] Move Spark Connect server to builtin package (Client API layer stays external)

+1 (non-binding), Kent Martin Grund 于2024年7月3日周三 14:11写道： > > +1 (non-binding) > > On Wed, Jul 3, 2024 at 07:25 Holden Karau wrote: >> >> +1 >> >> Twitter: https://twitter.com/holdenkarau >> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 >> YouTube Live Streams: h

[DISCUSS] Release Apache Spark 3.5.2

3.5.2, including some blockers and critical issues. What do you think about releasing 3.5.2? I am volunteering to take on the role of release manager for 3.5.2. Bests, Kent Yao [1] https://spark.apache.org/news/spark-3-5-1-released.html [2] https://issues.apache.org/jira/projects/SPARK/versions/123

Re: [DISCUSS] Release Apache Spark 3.5.2

>>> Thank you for the head-up and volunteering, Kent. > >>> > >>> +1 for 3.5.2 release. > >>> > >>> I can help you with the release steps which require Spark PMC permissions. > >>> > >>> Please let me know if you have any

[VOTE] Release Spark 3.5.2 (RC1)

hat has not been correctly targeted please ping me or a committer to help target the issue. Thanks, Kent Yao - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Spark 3.5.2 (RC1)

Thank you Wenchen. The vote is open until Jul 21, 11 AM UTC. Considering that the deadline falls on a weekend, the results might be counted on the following Monday. Bests, Kent Yao Wenchen Fan 于2024年7月18日周四 18:54写道： > > > The vote is open until Jul 18 > > Is it a typo? It&

Re: [VOTE] Release Spark 3.5.2 (RC1)

Thank you, Huaxin and L. C. Hsieh, for your input. We shall also include PRs like https://github.com/apache/spark/pull/47412 for correctness So, 3.5.2-RC1 failed, I will start RC2 in two or three days. Kent Yao L. C. Hsieh 于2024年7月19日周五 13:02写道： > > I also support -1 to include t

[VOTE] Release Spark 3.5.2 (RC2)

ression that has not been correctly targeted please ping me or a committer to help target the issue. Thanks, Kent Yao - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Differentiate Spark without Spark Connect from Spark Connect

+1 On 2024/07/23 02:04:17 Herman van Hovell wrote: > +1 > > On Mon, Jul 22, 2024 at 8:56 PM Wenchen Fan wrote: > > > +1 > > > > On Tue, Jul 23, 2024 at 8:40 AM Xinrong Meng wrote: > > > >> +1 > >> > >> Thank you @Hyukjin Kwon ! > >> > >> On Mon, Jul 22, 2024 at 5:20 PM Gengliang Wang wrote:

Re: [外部邮件] [VOTE] Release Spark 3.5.2 (RC2)

+1(non-binding), I have checked: - Download links are OK - Signatures, Checksums, and the KEYS file are OK - LICENSE and NOTICE are present - No unexpected binary files in source releases - Successfully built from source Thanks, Kent Yao On 2024/07/23 06:55:28 yangjie01 wrote: > +1, Thanks K

Re: [外部邮件] [VOTE] Release Spark 3.5.2 (RC2)

ly from the Delta metadata and > given to `PartitionedFile` and the Parquet reader output column vector for > partition column has the correct values. but somewhere the partition value > becomes null. Still debugging the RCA. > > Thanks > Venki > > On Tue, Jul 23, 2024 a

Re: [外部邮件] [VOTE] Release Spark 3.5.2 (RC2)

pache/spark/pull/47483 > > Can we cut a new RC? > > On Thu, Jul 25, 2024 at 3:13 PM Mridul Muralidharan wrote: >> >> >> +1 >> >> Signatures, digests, etc check out fine. >> Checked out tag and build/tested with -Phive -Pyarn -Pkubernetes >> &g

[VOTE] Release Spark 3.5.2 (RC3)

ression that has not been correctly targeted please ping me or a committer to help target the issue. Thanks, Kent Yao - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Spark 3.5.2 (RC3)

gt; > FYI, Python 3.12 Support was added to Apache Spark 4.0.0 only and `master` > branch is not affected. > > Dongjoon. > > > On Thu, Jul 25, 2024 at 6:06 AM Kent Yao wrote: > > > Hi dev, > > > > Please vote on releasing the following candidate as Apache Sp

[VOTE] Release Spark 3.5.2 (RC4)

ression that has not been correctly targeted please ping me or a committer to help target the issue. Thanks, Kent Yao - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [VOTE] Release Spark 3.5.2 (RC4)

: >> >> +1 (non-binding) >> >> - All links are valid and look good >> - Successful built from source code on Ubuntu 22.04 x86 with Java 17 >> - Have integrated and played with Zeppelin, Kyuubi, Iceberg and Hadoop, no >> unexpected issues found. >> >

[NOTICE] Progress of 3.5.2-RC5

/jira/browse/SPARK-49000 https://issues.apache.org/jira/browse/SPARK-49054 === ONGOING === https://issues.apache.org/jira/browse/SPARK-48950 https://issues.apache.org/jira/browse/SPARK-49030 Thanks, Kent Yao [1] https://lists.apache.org/thread/9lj57fh3zbo2h4koh5hr7nhdky21p6zg

Re: [NOTICE] Progress of 3.5.2-RC5

anymore; I will proceed to cut it soon. Thank you, everyone, for your understanding and patience. Kent Yao On 2024/08/01 20:32:07 Dongjoon Hyun wrote: > Thank you for summarizing them and leading the release, Kent. :) > > Dongjoon. > > On Wed, Jul 31, 2024 at 10:39 PM

[VOTE] Release Spark 3.5.2 (RC5)

ression that has not been correctly targeted please ping me or a committer to help target the issue. Thanks, Kent Yao - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Spark website repo size hits the storage limit of GitHub-hosted runners

have any other suggestions? Bests, Kent Yao [1] https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners/about-github-hosted-runners#standard-github-hosted-runners-for-public-repositories [2] https://github.com/apache/spark-w

Re: Spark website repo size hits the storage limit of GitHub-hosted runners

Hi Ruifeng, We have already ported those scripts Ruifeng Zheng 于2024年8月9日周五 12:41写道： > Hi Kent, I remember that we have some scripts to free disk in spark repo, > maybe we can reuse them for spark-website. > > On Fri, Aug 9, 2024 at 9:57 AM Sean Owen wrote: > >> I don't think that's the issue

Re: [DISCUSS] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 On 2024/08/08 23:24:32 Hyukjin Kwon wrote: > SGTM > > On Thu, 8 Aug 2024 at 14:53, Martin Grund > wrote: > > > Hi folks, > > > > I wanted to start a discussion for the following proposal: To make it > > easier for folks to contribute to the Spark Connect Go client, I was > > contemplating no

Re: [VOTE] Release Spark 3.5.2 (RC5)

using a third-party mail archiving service [2]. Thanks, everyone for the revote. Bests, Kent Yao [1] https://issues.apache.org/jira/browse/INFRA-26025 [2] https://www.mail-archive.com/dev@spark.apache.org/msg32050.html On 2024/08/08 18:21:20 Dongjoon Hyun wrote: > Hi, Kent and all. > > I

[VOTE][RESULT] Release Apache Spark 3.5.2 (RC5)

[VOTE][RESULT] Release Apache Spark 3.5.2 (RC5) The vote[1] passed with 12 +1s (6 bindings). Thanks to all who helped with the release! (* = binding) +1: Dongjoon Hyun (*) L. C. Hsieh (*) John Zhuge Huaxin Gao (*) Peter Toth XiDuo You Chao Sun (*) Cheng Pan Kent Yao Wenchen Fan (*) Gengliang

[VOTE] Archive Spark Documentations in Apache Archives

[ ] -1: I don’t think this is a good idea because … Bests, Kent Yao [1] https://lists.apache.org/thread/o0w4gqoks23xztdmjjj26jkp1yyg2bvq [2] https://spark.apache.org/release-process.html#upload-to-apache-release-directory [3] https://dist.apache.org/repos/dist/dev/spark/v3.5.2-rc5-docs/ [4] https

[ANNOUNCE] Apache Spark 3.5.2 released

possible without you. Kent Yao - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: ASF board report for August 2024

Hi Matei, We can replace 3.5.1 with 3.5.2 [1] in the 'Latest releases' section. - Spark 3.5.2 was released on August 10, 2024 Thanks Kent Yao [1] https://lists.apache.org/thread/of245s7z03w99lbj0txyqjvshdsohsk8 On 2024/08/12 06:54:56 Santosh Pingale wrote: > One nit: Community

Re: Welcome new Apache Spark committers

Congrats and welcome, Allison, Haejoon, and Martin! Kent On 2024/08/13 20:07:02 Ian Cook wrote: > Congratulations! > > On Tue, Aug 13, 2024 at 18:15 Matei Zaharia wrote: > > > Welcome all! > > > > > > On Aug 13, 2024, at 5:53 AM, bo yang wrote: > > > > Congratulations! > > > > On Tue, Aug 13,

Re: Welcoming a new PMC member

>>> Congratulations, Kent. > >>>>>> > >>>>>> Dongjoon. > >>>>>> > >>>>>> On Mon, Aug 12, 2024 at 5:22 PM Xiao Li >>>>>> <mailto:gatorsm...@gmail.com>> wrote: > >>>>>>> Congratulations ! > >>>>>>> > >>>>>>> Hyukjin Kwon mailto:gurwls...@apache.org>> > >>>>>>> 于2024年8月12日周一 17:20写道： > >>>>>>>> Hi all, > >>>>>>>> > >>>>>>>> The Spark PMC recently voted to add a new PMC member, Kent Yao. Join > >>>>>>>> me in welcoming him to his new role! > >>>>>>>> > > - To unsubscribe e-mail: dev-unsubscr...@spark.apache.org

Re: [DISCUSS] Deprecating SparkR

+1 On 2024/08/13 23:45:11 Xiangrui Meng wrote: > +1 > > On Tue, Aug 13, 2024, 2:43 PM Jungtaek Lim > wrote: > > > +1 > > > > Looks to be sufficient to VOTE? > > > > 2024년 8월 14일 (수) 오전 1:10, Wenchen Fan 님이 작성: > > > >> +1 > >> > >> On Tue, Aug 13, 2024 at 10:50 PM L. C. Hsieh wrote: > >> > >>>

Re: [VOTE] Archive Spark Documentations in Apache Archives

nd possible malformed content issues when viewing by different mail clients. Thank you all for participating in the vote, the vote passed with sufficient binding +1s, and I will raise a new thread to summarize. Kent Yao On 2024/08/12 18:08:04 Wenchen Fan wrote: > +1 > > On Tue, Aug

[VOTE][RESULT] Archive Spark Documentations in Apache Archives

Hi dev, The vote[1] for 'Archive Spark Documentations in Apache Archives' passed with 9 +1s (7 bindings, * = binding): +1: Sean Owen (*) Mich Talebzadeh Dongjoon Hyun (*) Holden Karau (*) Wenchen Fan (*) Xiao Li (*) Gengliang Wang (*) Denny Lee Kent Yao (*) +0: None -1: None Thanks

Re: Apache Spark 4.0.0-preview2 (?)

+1 Thank you Dongjoon Kent On 2024/09/09 15:32:12 Dongjoon Hyun wrote: > Thank you, Liang-Chi, Zhou, Huaxin, Bjørn, Hyukjin, Xinron, Wenchen, Terry, > Yang! > > I'll start to prepare the 1st release candidate for next Monday (9/16). > > Dongjoon. > > -

Re: [VOTE] Release Apache Spark 3.5.3 (RC3)

+1, thank you, Haejoon Kent On 2024/09/11 06:12:19 Gengliang Wang wrote: > +1 > > On Mon, Sep 9, 2024 at 6:01 PM Wenchen Fan wrote: > > > +1 > > > > On Tue, Sep 10, 2024 at 7:42 AM Rui Wang > > wrote: > > > >> +1 (non-binding) > >> > >> > >> -Rui > >> > >> On Mon, Sep 9, 2024 at 4:22 PM Hyukji

[VOTE] Document and Feature Preview via GitHub Pages

Hi all, Following the discussion[1], I'd like to start the vote for 'Document and Feature Preview via GitHub Pages' Please vote for the next 72 hours:(excluding next weekend) [ ] +1: Accept the proposal [ ] +0 [ ]- 1: I don’t think this is a good idea because … Bests, Kent

Re: [VOTE] Release Spark 3.4.4 (RC1)

+1, thank you Dongjoon! Kent Yao L. C. Hsieh 于2024年10月22日周二 10:21写道： > > +1 > > Thanks Dongjoon! > > On Mon, Oct 21, 2024 at 5:45 PM Xinrong Meng wrote: > > > > +1 > > > > Thank you Dongjoon! > > > > On Tue, Oct 22, 2024 at 8:35 AM

Re: [VOTE] Document and Feature Preview via GitHub Pages

+1 Thank you all for participating in the vote. I'll conclude this vote. Bests, Kent Yao On 2024/09/12 04:46:26 "Liu(Laswift) Cao" wrote: > +1 (non-binding) > > Thank you Kent > > On Wed, Sep 11, 2024 at 9:14 PM Holden Karau wrote: > > > +1 > >

[VOTE][RESULT] Document and Feature Preview via GitHub Pages

Hi dev, The vote[1] for 'Document and Feature Preview via GitHub Pages' passed with 11 +1s (8 bindings, * = binding): +1: Martin Grund Wenchen Fan (*) Gengliang Wang (*) Dongjoon Hyun (*) Mich Talebzadeh Hyukjin Kwon (*) Ruifeng Zheng (*) Xiao Li (*) Holden Karau (*) Liu Cao Kent Y

Re: [VOTE] Release Spark 3.5.4 (RC1)

+1(binding). Thank you, Jie Kent 杨杰 于2024年12月9日周一 14:37写道： > Please vote on releasing the following candidate as Apache Spark version > 3.5.4. > > The vote is open until Dec 12, 7:00:00 UTC and passes if a majority +1 PMC > votes are cast, with > a minimum of 3 +1 votes. > > [ ] +1 Release this

Re: [DISCUSS] Use plain text logs by default

+1 On 2024/11/23 02:50:36 Wenchen Fan wrote: > Hi Martin, > > Yea, we should be more deliberate about when to use Structured Logging. Let > me start with when people prefer plain text logs: > - Spark engine developers like us. When running tests, the logs are printed > in the console and plain te

Re: [DISCUSS] Release Apache Spark 3.5.4

+1, thank you, Jie Bests, Kent 杨杰 于2024年12月4日周三 11:27写道： > Hi dev, > > It's been approximately 3 months since Sep 9, 2024, when we released > version 3.5.3 for branch-3.5. The patchset differing from 3.5.3 has grown > significantly, now it contains 57 commits. > > The JIRA[2] also indicates tha

Re: [DISCUSS] SPIP: Declarative Pipelines

+1 Kent Yao Sem 于2025年4月9日周三 14:08写道： > +1 (non-binding) > > > On April 9, 2025 7:29:40 AM GMT+02:00, Rishab Joshi > wrote: > >> +1 Exciting. >> Rishab Joshi >> >> On Tue, Apr 8, 2025, 10:04 PM Ruifeng Zheng wrote: >> >>> +1

  1   2   >