Re: setuptools 78.0.0 does not work with pyspark 3.x releases

2025-04-05 Thread Sean Owen
It'll have to come with the next 3.5 release regardless, that will happen later as needed. I think we should just get it in soonish to enable that if needed. On Mon, Mar 24, 2025, 12:14 PM Bjørn Jørgensen wrote: > Yes, I did make that PR a long time ago. It was merged on 20.11.2023. > > I can

Re: setuptools 78.0.0 does not work with pyspark 3.x releases

2025-04-04 Thread Bjørn Jørgensen
Yes, I did make that PR a long time ago. It was merged on 20.11.2023. I can backport it.. it is only changing - to _ but I don't think that we have anyone to make a new spark version 3.5.X today and release it? Or do we have anyone that will make a new spark 3.5 release very soon? https://github.

Re: setuptools 78.0.0 does not work with pyspark 3.x releases

2025-03-25 Thread Hyukjin Kwon
Just fixed. Thanks guys for the quick fixes proposed. I woke up in my timezone, and went like wow :-). On Tue, 25 Mar 2025 at 05:33, Bjørn Jørgensen wrote: > https://setuptools.pypa.io/en/latest/history.html#v78-0-2 > > v78.0.2 > 24 Mar 2025 > > Bugfixes > Postponed removals of deprecated dash-s

Re: setuptools 78.0.0 does not work with pyspark 3.x releases

2025-03-24 Thread Bjørn Jørgensen
https://setuptools.pypa.io/en/latest/history.html#v78-0-2 v78.0.2 24 Mar 2025 Bugfixes Postponed removals of deprecated dash-separated and uppercase fields in setup.cfg. All packages with deprecated configurations are advised to move before 2026. (#4911

Re: setuptools 78.0.0 does not work with pyspark 3.x releases

2025-03-24 Thread James Willis
Perhaps it is sufficient to wait for setuptools to revert the change: https://github.com/pypa/setuptools/pull/4911 On Mon, Mar 24, 2025 at 11:38 AM Holden Karau wrote: > I think given the lack of 4.0 release and the amount of folks using > PySpark this is enough to trigger a 3.5 branch release.

Re: setuptools 78.0.0 does not work with pyspark 3.x releases

2025-03-24 Thread Holden Karau
I think given the lack of 4.0 release and the amount of folks using PySpark this is enough to trigger a 3.5 branch release. Twitter: https://twitter.com/holdenkarau Fight Health Insurance: https://www.fighthealthinsurance.com/ Books (Learning Spar