Perhaps it is sufficient to wait for setuptools to revert the change: https://github.com/pypa/setuptools/pull/4911
On Mon, Mar 24, 2025 at 11:38 AM Holden Karau <holden.ka...@gmail.com> wrote: > I think given the lack of 4.0 release and the amount of folks using > PySpark this is enough to trigger a 3.5 branch release. > > Twitter: https://twitter.com/holdenkarau > Fight Health Insurance: https://www.fighthealthinsurance.com/ > <https://www.fighthealthinsurance.com/?q=hk_email> > Books (Learning Spark, High Performance Spark, etc.): > https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> > YouTube Live Streams: https://www.youtube.com/user/holdenkarau > Pronouns: she/her > > > On Mon, Mar 24, 2025 at 10:18 AM Sean Owen <sro...@apache.org> wrote: > >> It'll have to come with the next 3.5 release regardless, that will happen >> later as needed. I think we should just get it in soonish to enable that if >> needed. >> >> >> >> On Mon, Mar 24, 2025, 12:14 PM Bjørn Jørgensen <bjornjorgen...@gmail.com> >> wrote: >> >>> Yes, I did make that PR a long time ago. It was merged on 20.11.2023. >>> >>> I can backport it.. it is only changing - to _ but I don't think that we >>> have anyone to make a new spark version 3.5.X today and release it? >>> Or do we have anyone that will make a new spark 3.5 release very soon? >>> >>> https://github.com/apache/spark/pull/50369 >>> <https://github.com/apache/spark/pull/50369> >>> >>> man. 24. mars 2025 kl. 17:32 skrev Sean Owen <sro...@apache.org>: >>> >>>> I think we're about to hear about this: >>>> >>>> setuptools 78.0.0, released yesterday, no longer allows dashes in keys >>>> in setup.cfg: >>>> https://setuptools.pypa.io/en/stable/history.html#v78-0-0 >>>> >>>> The pyspark packaging has 'description-file' instead of >>>> 'description_file' in its setup.cfg, and so will not install. >>>> >>>> This was addressed for Spark 4.0 in >>>> https://issues.apache.org/jira/browse/SPARK-45994 >>>> I think this just needs to be backported, but, it'll be kind of >>>> unfortunate because older releases won't install, I think. >>>> >>>> >>>> >>> >>> -- >>> Bjørn Jørgensen >>> Vestre Aspehaug 4, 6010 Ålesund >>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>> Norge >>> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >>> >>> +47 480 94 297 >>> >>
