Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Sean Owen
I think people are still reading "deprecated" as "removed". It 100% does not mean that. Wouldn't it be more likely that 'old' things are deprecated than new? What is light about this 100+ message discussion? I myself did not see any strong arguments against deprecation, which seemed to amount to "m

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Russell Jurney
Not sure what you mean? GraphX is the core Apache Spark technology underneath GraphFrames - parts of GraphFrames use it. `git grep -i graphx | wc -l` shows 147 hits for `graphx` in GraphFrames master branch as of now. I started out getting familiar with the GraphFrames codebase with some low hangi

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Ángel
I thought that too ... until I read the message from Matei Zaharia: "Votes to deprecate both SparkR and GraphX have passed. These components will officially be deprecated in Spark 4." Didn't know in open source you could deprecate things that have been there years so lightly without carrying out

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Holden Karau
So it’s deprecated but I will review some basic graph X PRs as I would like us to bring graph X back to life — but under our current release structure we need to deprecate now if we want to be able to remove it in the next few years. Twitter: https://twitter.com/holdenkarau Fight Health Insurance:

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Russell Jurney
I guess you missed where Reynold Xin suggested we instead bring GraphFrames into Spark and others agreed? On Tue, Nov 12, 2024 at 12:08 PM Ángel wrote: > You only have to look at the subject of this thread of mails. It says > nothing about graphframes. I thought we were "fighting" against deprec

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Ángel
Nope. didn't miss that, in fact, I mentioned that graphframes used GraphX under the hood. The thing is ... even though we were trying to get maintainers the deprecation of GraphX passed suddenly in the middle of that discussion. El mar, 12 nov 2024, 21:47, Russell Jurney escribió: > I guess you

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Russell Jurney
That is unfortunate. I saw someone volunteer to review my PRs. I thought there was a holdout? On Tue, Nov 12, 2024 at 12:56 PM Ángel wrote: > Nope. didn't miss that, in fact, I mentioned that graphframes used GraphX > under the hood. > > The thing is ... even though we were trying to get maintai

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Ángel
👍 El mié, 13 nov 2024, 3:52, Holden Karau escribió: > So it’s deprecated but I will review some basic graph X PRs as I would > like us to bring graph X back to life — but under our current release > structure we need to deprecate now if we want to be able to remove it in > the next few years. >

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Russell Jurney
Angel, okay, I see the announcement. Thanks for bringing that to my attention. So, I started out getting up to speed on GraphFrames and doing a little maintenance. Next I'm going to go in and fix some bugs in GraphX. On the GraphFrames side, there is actually a bug converting GraphFrames to GraphX

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Ángel
When you deprecate something, the message you're sending out is: "This feature is no longer supported, maintained, and recommended for production use." The problem is that nobody knows how many Spark programs currently rely on GraphX/Graphframes in production and the impact that decisssion could ha

Re: ASF board report draft for November 2024

2024-11-12 Thread Bjørn Jørgensen
ohh.. my fault https://lists.apache.org/thread/2nd08qpr8nwbtog5bgnpfgkn1r42cd5m tir. 12. nov. 2024 kl. 20:37 skrev Bjørn Jørgensen : > "*GraphX have passed*" > > @Holden Karau Did it? > > > > man. 11. nov. 2024 kl. 00:52 skrev Matei Zaharia >: > >> It’s time to send out our ASF board report a

Re: ASF board report draft for November 2024

2024-11-12 Thread Bjørn Jørgensen
"*GraphX have passed*" @Holden Karau Did it? man. 11. nov. 2024 kl. 00:52 skrev Matei Zaharia : > It’s time to send out our ASF board report again this Wednesday. Here is a > draft — let me know if you have comments or suggestions. > > === > > Description: > > Apache Spark is a fa

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Ángel
You only have to look at the subject of this thread of mails. It says nothing about graphframes. I thought we were "fighting" against deprecating GraphX because it seemed not have any maintainers in quite a few time. Maybe I got it wrong. El mar, 12 nov 2024, 19:12, Russell Jurney escribió: > No

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Sean Owen
I think this was all discussed at length. While Spark of course doesn't collect usage stats, we do have evidence that was discussed: low commit activity and traffic to this section of the docs. The argument that it could impact someone doesn't go anywhere - of course it will impact _someone_. How m

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Russell Jurney
I started working on GraphFrames this weekend, got it building and started with some docs PRs. A lot of the example code no longer worked, so I fixed it. I'm updating the docs to indicate our plan to integrate it with Apache Spark. I'll announce a hackathon in the next week or so :) Russell On W

Re: [DISCUSS] Deprecate GraphX OR Find new maintainers interested in GraphX OR leave it as is?

2024-11-12 Thread Ángel
But the goal wasn't to fix bugs in GraphX? What has that to do with graphframes? El mar, 12 nov 2024, 12:58, Russell Jurney escribió: > I started working on GraphFrames this weekend, got it building and started > with some docs PRs. A lot of the example code no longer worked, so I fixed > it. I'