Re: Drop Python 2 support from GraphFrames?

2025-01-31 Thread Mich Talebzadeh
+1 long overdue Dr Mich Talebzadeh, Architect | Data Science | Financial Crime | Forensic Analysis | GDPR view my Linkedin profile On Sat, 1 Feb 2025 at 02:16, Russell Jurney wrote: > Oh, wonderful! That should about settle it,

Re: Drop Python 2 support from GraphFrames?

2025-01-31 Thread Russell Jurney
Oh, wonderful! That should about settle it, then. I am now converting all the nose tests to pytests which will allow GraphFrames to run Python 3.11. Russell On Fri, Jan 31, 2025 at 5:20 PM Holden Karau wrote: > We no longer support Python 2 in Spark > > Twitter: https://twitter.com/holdenkarau

Re: Drop Python 2 support from GraphFrames?

2025-01-31 Thread Jules Damji
On Fri, 31 Jan 2025 at 5:21 PM, Holden Karau wrote: We no longer support Python 2 in Spark > +1 > Excuse the thumb typos > > Twitter: https://twitter.com/holdenkarau > Fight Health Insurance: https://www.fighthealthinsurance.com/ > > Books (L

Re: Drop Python 2 support from GraphFrames?

2025-01-31 Thread Holden Karau
We no longer support Python 2 in Spark Twitter: https://twitter.com/holdenkarau Fight Health Insurance: https://www.fighthealthinsurance.com/ Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9

Drop Python 2 support from GraphFrames?

2025-01-31 Thread Russell Jurney
So... including the Spark user list for a broader perspective on Python 2 PySpark users. I want to remove Python 2 support from GraphFrames so I don't have to think about it or work in Python 2... I wrote this up in the issue Drop support for Python 2

Re: [Spark SQL]: Are SQL User-Defined Functions on the Roadmap?

2025-01-31 Thread Mich Talebzadeh
Hi Frank, I think this would be for the Spark dev team. I have added to the email. HTH Dr Mich Talebzadeh, Architect | Data Science | Financial Crime | Forensic Analysis | GDPR view my Linkedin profile On Fri, 31 Jan 2025 at 14:

[Spark SQL]: Are SQL User-Defined Functions on the Roadmap?

2025-01-31 Thread Frank Bertsch
Hi All - I'm working heavily in Spark SQL lately. Specifically, I've been trying to understand if SQL UDFs, similar to the databricks offering , is being tracked as a feature request within Apache Spark, and if

Re: Help choose a GraphFrames logo

2025-01-31 Thread Mich Talebzadeh
Hi Russell, Has this been finalised as I ticked my preference today (could be too late) Dr Mich Talebzadeh, Architect | Data Science | Financial Crime | Forensic Analysis | GDPR view my Linkedin profile On Sun, 19 Jan 2025 at 03: