Re: [DISCUSS] Deprecating SparkR

+1 On Tue, Aug 13, 2024 at 1:08 PM Holden Karau wrote: > +1 > > Are the sparklyr folks on this list? > > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): > https://amzn.to/2MaRAG9 > YouTube Live Streams: https://www.youtu

Re: [DISCUSS] Deprecating SparkR

+1 Dongjoon On Mon, Aug 12, 2024 at 17:52 Holden Karau wrote: > +1 > > Are the sparklyr folks on this list? > > Twitter: https://twitter.com/holdenkarau > Books (Learning Spark, High Performance Spark, etc.): > https://amzn.to/2MaRAG9 > YouTube Live Streams: https://w

Re: Welcome new Apache Spark committers

Congratulations, everyone! On Mon, Aug 12, 2024 at 7:10 PM Denny Lee wrote: > Congrats Allison, Martin, and Haejoon! > > On Tue, Aug 13, 2024 at 9:59 AM Jungtaek Lim > wrote: > >> Congrats everyone! >> >> On Tue, Aug 13, 2024 at 9:21 AM Xiao Li wrote: >> >>> Congratulations! >>> >>> Hyukjin Kw

Re: Welcoming a new PMC member

Congratulations! On Mon, Aug 12, 2024 at 7:12 PM Denny Lee wrote: > Congrats, Kent! > > On Tue, Aug 13, 2024 at 9:06 AM Dongjoon Hyun > wrote: > >> Congratulations, Kent. >> >> Dongjoon. >> >> On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: >> >>> Congratulations ! >>> >>> Hyukjin Kwon 于2024年8

Re: [DISCUSS] Deprecating SparkR

+1 (non-binding) On Mon, Aug 12, 2024, 6:56 PM Mridul Muralidharan wrote: > > +1 > > Regards, > Mridul > > On Mon, Aug 12, 2024 at 6:18 PM Hyukjin Kwon wrote: > >> +1 >> >> On Tue, Aug 13, 2024 at 7:04 AM Nicholas Chammas < >> nicholas.cham...@gmail.com> wrote: >> >>> And just for the record, t

Re: Welcoming a new PMC member

Congrats, Kent! On Tue, Aug 13, 2024 at 9:06 AM Dongjoon Hyun wrote: > Congratulations, Kent. > > Dongjoon. > > On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: > >> Congratulations ! >> >> Hyukjin Kwon 于2024年8月12日周一 17:20写道： >> >>> Hi all, >>> >>> The Spark PMC recently voted to add a new PMC m

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 (non-binding) On Tue, Aug 13, 2024 at 6:16 AM Gengliang Wang wrote: > +1 > > On Mon, Aug 12, 2024 at 2:01 PM Xiao Li wrote: > >> +1 >> >> Mich Talebzadeh 于2024年8月12日周一 13:11写道： >> >>> Hi Kent, >>> >>> Can you if possible please provide a heuristic estimate of storage >>> reduction that will

Re: Welcome new Apache Spark committers

Congrats Allison, Martin, and Haejoon! On Tue, Aug 13, 2024 at 9:59 AM Jungtaek Lim wrote: > Congrats everyone! > > On Tue, Aug 13, 2024 at 9:21 AM Xiao Li wrote: > >> Congratulations! >> >> Hyukjin Kwon 于2024年8月12日周一 17:19写道： >> >>> Hi all, >>> >>> The Spark PMC recently voted to add three ne

Re: Welcome new Apache Spark committers

Congratulations, everyone! On Mon, Aug 12, 2024 at 6:58 PM Jungtaek Lim wrote: > Congrats everyone! > > On Tue, Aug 13, 2024 at 9:21 AM Xiao Li wrote: > >> Congratulations! >> >> Hyukjin Kwon 于2024年8月12日周一 17:19写道： >> >>> Hi all, >>> >>> The Spark PMC recently voted to add three new committers

Re: Welcoming a new PMC member

Congratulations! On Mon, Aug 12, 2024 at 6:22 PM Jungtaek Lim wrote: > Congrats, Kent! > > On Tue, Aug 13, 2024 at 10:06 AM Dongjoon Hyun > wrote: > >> Congratulations, Kent. >> >> Dongjoon. >> >> On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: >> >>> Congratulations ! >>> >>> Hyukjin Kwon 于20

Re: Welcome new Apache Spark committers

Congratulations ! Regards, Mridul On Mon, Aug 12, 2024 at 7:27 PM Dongjoon Hyun wrote: > Congratulations, Martin, Haejoon, Allison. :) > > Dongjoon > > On Mon, Aug 12, 2024 at 5:19 PM Hyukjin Kwon wrote: > >> Hi all, >> >> The Spark PMC recently voted to add three new committers. Please join m

Re: Welcoming a new PMC member

Congratulations Kent ! Regards, Mridul On Mon, Aug 12, 2024 at 8:46 PM Dongjoon Hyun wrote: > Congratulations, Kent. > > Dongjoon. > > On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: > >> Congratulations ! >> >> Hyukjin Kwon 于2024年8月12日周一 17:20写道： >> >>> Hi all, >>> >>> The Spark PMC recently

Re: [DISCUSS] Deprecating SparkR

+1 Regards, Mridul On Mon, Aug 12, 2024 at 6:18 PM Hyukjin Kwon wrote: > +1 > > On Tue, Aug 13, 2024 at 7:04 AM Nicholas Chammas < > nicholas.cham...@gmail.com> wrote: > >> And just for the record, the stats that I screenshotted >>

Re: Welcoming a new PMC member

Congrats, Kent! On Tue, Aug 13, 2024 at 10:06 AM Dongjoon Hyun wrote: > Congratulations, Kent. > > Dongjoon. > > On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: > >> Congratulations ! >> >> Hyukjin Kwon 于2024年8月12日周一 17:20写道： >> >>> Hi all, >>> >>> The Spark PMC recently voted to add a new PMC

Re: Welcome new Apache Spark committers

Congrats everyone! On Tue, Aug 13, 2024 at 9:21 AM Xiao Li wrote: > Congratulations! > > Hyukjin Kwon 于2024年8月12日周一 17:19写道： > >> Hi all, >> >> The Spark PMC recently voted to add three new committers. Please join me >> in welcoming them to their new role! >> >> - Martin Grund >> - Haejoon Lee

Re: Welcoming a new PMC member

Congratulations! Yuming Wang 于2024年8月13日周二 08:28写道： > > Congratulations! > > On Mon, Aug 12, 2024 at 5:20 PM Hyukjin Kwon wrote: >> >> Hi all, >> >> The Spark PMC recently voted to add a new PMC member, Kent Yao. Join me in >> welcoming him to his new role! >> -

Re: [DISCUSS] Deprecating SparkR

+1 Are the sparklyr folks on this list? Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 YouTube Live Streams: https://www.youtube.com/user/holdenkarau Pronouns: she/her On Mon, Aug 12, 2024 at 5:22

Re: Welcoming a new PMC member

Congratulations! On Mon, Aug 12, 2024 at 5:20 PM Hyukjin Kwon wrote: > Hi all, > > The Spark PMC recently voted to add a new PMC member, Kent Yao. Join me in > welcoming him to his new role! > >

Re: Welcome new Apache Spark committers

Congratulations, Martin, Haejoon, Allison. :) Dongjoon On Mon, Aug 12, 2024 at 5:19 PM Hyukjin Kwon wrote: > Hi all, > > The Spark PMC recently voted to add three new committers. Please join me > in welcoming them to their new role! > > - Martin Grund > - Haejoon Lee > - Allison Wang > > They c

Re: Welcoming a new PMC member

Congratulations, Kent. Dongjoon. On Mon, Aug 12, 2024 at 5:22 PM Xiao Li wrote: > Congratulations ! > > Hyukjin Kwon 于2024年8月12日周一 17:20写道： > >> Hi all, >> >> The Spark PMC recently voted to add a new PMC member, Kent Yao. Join me >> in welcoming him to his new role! >> >>

Re: [ANNOUNCE] Apache Spark 3.5.2 released

Thank you, Kent! Kent Yao 于2024年8月12日周一 08:03写道： > We are happy to announce the availability of Apache Spark 3.5.2! > > Spark 3.5.2 is the second maintenance release containing security > and correctness fixes. This release is based on the branch-3.5 > maintenance branch of Spark. We strongly re

Re: Welcoming a new PMC member

Congratulations ! Hyukjin Kwon 于2024年8月12日周一 17:20写道： > Hi all, > > The Spark PMC recently voted to add a new PMC member, Kent Yao. Join me in > welcoming him to his new role! > >

Re: [DISCUSS] Deprecating SparkR

+1 Hyukjin Kwon 于2024年8月12日周一 16:18写道： > +1 > > On Tue, Aug 13, 2024 at 7:04 AM Nicholas Chammas < > nicholas.cham...@gmail.com> wrote: > >> And just for the record, the stats that I screenshotted >>

Re: Welcome new Apache Spark committers

Congratulations! Hyukjin Kwon 于2024年8月12日周一 17:19写道： > Hi all, > > The Spark PMC recently voted to add three new committers. Please join me > in welcoming them to their new role! > > - Martin Grund > - Haejoon Lee > - Allison Wang > > They consistently made contributions to the project and clear

Welcoming a new PMC member

Hi all, The Spark PMC recently voted to add a new PMC member, Kent Yao. Join me in welcoming him to his new role!

Welcome new Apache Spark committers

Hi all, The Spark PMC recently voted to add three new committers. Please join me in welcoming them to their new role! - Martin Grund - Haejoon Lee - Allison Wang They consistently made contributions to the project and clearly showed their expertise. We are very excited to have them join as commi

Re: [VOTE] Archive Spark Documentations in Apache Archives

ok thanks Based on the list you provided, I make it to be a total of 11.88 GB. cat convert_sum.awk { split($1, a, /[MG]/) val = a[1] unit = a[2] if (unit == "G") { val = val * 1024 } sum += val } END { printf("%.2f GB\n", sum / 1024) } awk -f convert_sum.awk s

Re: [DISCUSS] Deprecating SparkR

+1 On Tue, Aug 13, 2024 at 7:04 AM Nicholas Chammas wrote: > And just for the record, the stats that I screenshotted > > in > that t

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 On Tue, Aug 13, 2024 at 6:01 AM bo yang wrote: > +1 > > On Mon, Aug 12, 2024 at 9:14 AM Matthew Powers < > matthewkevinpow...@gmail.com> wrote: > >> +1 (non-binding) >> >> On Mon, Aug 12, 2024 at 12:11 PM Denny Lee wrote: >> >>> +1 (non-binding) >>> >>> On Mon, Aug 12, 2024 at 16:43 Reynold

Re: [VOTE] Archive Spark Documentations in Apache Archives

He did already; see the preceding thread here on dev@. You can figure the size that moves out of the repo from the docs sizes: 9.9M ./0.6.0 10M ./0.6.1 10M ./0.6.2 15M ./0.7.0 16M ./0.7.2 16M ./0.7.3 20M ./0.8.0 20M ./0.8.1 38M ./0.9.0 38M ./0.9.1 38M ./0.9.2 36M ./1.0.0 38M ./1.0.1

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 On Mon, Aug 12, 2024 at 2:01 PM Xiao Li wrote: > +1 > > Mich Talebzadeh 于2024年8月12日周一 13:11写道： > >> Hi Kent, >> >> Can you if possible please provide a heuristic estimate of storage >> reduction that will be achieved through this approach? >> >> Thanks >> >> Mich Talebzadeh, >> >> Architect

Re: [DISCUSS] Deprecating SparkR

And just for the record, the stats that I screenshotted in that thread I linked to showed the following page views for each sub-secti

Re: [DISCUSS] Deprecating SparkR

Not an R user myself, but +1. I first wondered about the future of SparkR after noticing how low the visit stats were for the R API docs as compared to Python and Scala. (I can’t seem to find those visit stats

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 Matthew Powers 于2024年8月12日周一 09:14写道： > +1 (non-binding) > > On Mon, Aug 12, 2024 at 12:11 PM Denny Lee wrote: > >> +1 (non-binding) >> >> On Mon, Aug 12, 2024 at 16:43 Reynold Xin >> wrote: >> >>> +1 >>> >>> On Mon, Aug 12, 2024 at 10:28 AM Mich Talebzadeh < >>> mich.talebza...@gmail.com>

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 Mich Talebzadeh 于2024年8月12日周一 13:11写道： > Hi Kent, > > Can you if possible please provide a heuristic estimate of storage > reduction that will be achieved through this approach? > > Thanks > > Mich Talebzadeh, > > Architect | Data Engineer | Data Science | Financial Crime > PhD

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 On Mon, Aug 12, 2024 at 9:14 AM Matthew Powers wrote: > +1 (non-binding) > > On Mon, Aug 12, 2024 at 12:11 PM Denny Lee wrote: > >> +1 (non-binding) >> >> On Mon, Aug 12, 2024 at 16:43 Reynold Xin >> wrote: >> >>> +1 >>> >>> On Mon, Aug 12, 2024 at 10:28 AM Mich Talebzadeh < >>> mich.talebz

Re: [VOTE] Archive Spark Documentations in Apache Archives

Hi Kent, Can you if possible provide a heuristic estimate of space reduction your proposal is going to achieve? Thanks Mich Talebzadeh, Architect | Data Engineer | Data Science | Financial Crime PhD Imperial College London

Re: [DISCUSS] Communicating over Slack instead of e-mails

I'm not sure I agree with your assumptions: I think that following a thread is much more easy in Slack compared to multiple email threads- and refreshing my memory on the conversation context for messages is easier as well. I haven't found the indexing of current conversations to be that good- bu

Re: [VOTE] Archive Spark Documentations in Apache Archives

Hi Kent, Can you if possible please provide a heuristic estimate of storage reduction that will be achieved through this approach? Thanks Mich Talebzadeh, Architect | Data Engineer | Data Science | Financial Crime PhD Imperial College London

Re: [DISCUSS] Communicating over Slack instead of e-mails

If you’re proposing that Slack replace this dev list, then chat is not an appropriate substitute for emails. Conversations fly by on a conveyor belt, context is easily fractured across multiple threads and short messages, information is poorly indexed by search engines, and the lower bar of entr

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 On Tue, Aug 13, 2024 at 1:57 AM Holden Karau wrote: > +1 > > > On Mon, Aug 12, 2024 at 10:17 AM Dongjoon Hyun > wrote: > >> +1 for the proposals >> - enhancing the release process to put the docs to `release` directory in >> order to archive. >> - uploading old releases via SVN manually to a

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 On Mon, Aug 12, 2024 at 10:17 AM Dongjoon Hyun wrote: > +1 for the proposals > - enhancing the release process to put the docs to `release` directory in > order to archive. > - uploading old releases via SVN manually to archive. > > Since deletion is not a scope of this vote, I don't see any

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 for the proposals - enhancing the release process to put the docs to `release` directory in order to archive. - uploading old releases via SVN manually to archive. Since deletion is not a scope of this vote, I don't see any risk here. Thank you, Kent. Dongjoon. On 2024/08/12 09:07:47 Kent Y

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+0 (binding) Twitter: https://twitter.com/holdenkarau Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 YouTube Live Streams: https://www.youtube.com/user/holdenkarau Pronouns: she/her On Mon, Aug 12, 2024 at 9:14 AM Matthew Powers wrote:

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 (non-binding) On Mon, Aug 12, 2024 at 12:11 PM Denny Lee wrote: > +1 (non-binding) > > On Mon, Aug 12, 2024 at 16:43 Reynold Xin > wrote: > >> +1 >> >> On Mon, Aug 12, 2024 at 10:28 AM Mich Talebzadeh < >> mich.talebza...@gmail.com> wrote: >> >>> +1 for me >>> >>> Mich Talebzadeh, >>> >>> Ar

[DISCUSS] Deprecating SparkR

Hi About ten years ago, I created the original SparkR package as part of my research at UC Berkeley [SPARK-5654 ]. After my PhD I started as a professor at UW-Madison and my contributions to SparkR have been in the background given my availability.

Re: ASF board report for August 2024

Hi Matei, We can replace 3.5.1 with 3.5.2 [1] in the 'Latest releases' section. - Spark 3.5.2 was released on August 10, 2024 Thanks Kent Yao [1] https://lists.apache.org/thread/of245s7z03w99lbj0txyqjvshdsohsk8 On 2024/08/12 06:54:56 Santosh Pingale wrote: > One nit: Community is voting for

[ANNOUNCE] Apache Spark 3.5.2 released

We are happy to announce the availability of Apache Spark 3.5.2! Spark 3.5.2 is the second maintenance release containing security and correctness fixes. This release is based on the branch-3.5 maintenance branch of Spark. We strongly recommend all 3.5 users to upgrade to this stable release. To

Re: [VOTE] Archive Spark Documentations in Apache Archives

Hello, On the face of it, this email contains many references, making it difficult to follow. Perhaps, a simpler explanation could improve voting participation. The STAR methodology can be helpful in understanding and evaluating this proposal. STAR stands for Situation, Task, Action, Result. Let

Re: [VOTE] Archive Spark Documentations in Apache Archives

+1 with the following clarifications, for my benefit: Once we upload to release, and it's copied by archive, we delete from release right? I know we are meant to keep the files in release minimal as they're mirrored to all ASF mirrors. But if we're uploading some batches and deleting them after, t

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 (non-binding) On Mon, Aug 12, 2024 at 16:43 Reynold Xin wrote: > +1 > > On Mon, Aug 12, 2024 at 10:28 AM Mich Talebzadeh < > mich.talebza...@gmail.com> wrote: > >> +1 for me >> >> Mich Talebzadeh, >> >> Architect | Data Engineer | Data Science | Financial Crime >> PhD

[VOTE] Archive Spark Documentations in Apache Archives

Archive Spark Documentations in Apache Archives Hi dev, To address the issue of the Spark website repository size reaching the storage limit for GitHub-hosted runners [1], I suggest enhancing step [2] in our release process by relocating the documentation releases from the dev[3] directory to the

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 On Mon, Aug 12, 2024 at 10:28 AM Mich Talebzadeh wrote: > +1 for me > > Mich Talebzadeh, > > Architect | Data Engineer | Data Science | Financial Crime > PhD Imperial College > London

Re: [VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

+1 for me Mich Talebzadeh, Architect | Data Engineer | Data Science | Financial Crime PhD Imperial College London London, United Kingdom view my Linkedin profile

[VOTE] Using Github Issues for Spark-Connect-Go _only_ issues.

Hi Folks, following the discussion in the previous thread, I would like to open the vote on the following proposal: Enabling the use of GitHub Issues for issue tracking for the Spark Connect Go repository. This will support the tracking of issues that are exclusively relevant to this project. For

[DISCUSS] Communicating over Slack instead of e-mails

Hi all, Many other oss projects (some of which include some of the participants of this mailing list I'm sure) are using Slack as a more modern communication channel. I find Slack to be more appropriate these days, easier to navigate through groups, easier to see context of different threads and