I think given the lack of 4.0 release and the amount of folks using PySpark this is enough to trigger a 3.5 branch release.
Twitter: https://twitter.com/holdenkarau Fight Health Insurance: https://www.fighthealthinsurance.com/ <https://www.fighthealthinsurance.com/?q=hk_email> Books (Learning Spark, High Performance Spark, etc.): https://amzn.to/2MaRAG9 <https://amzn.to/2MaRAG9> YouTube Live Streams: https://www.youtube.com/user/holdenkarau Pronouns: she/her On Mon, Mar 24, 2025 at 10:18 AM Sean Owen <sro...@apache.org> wrote: > It'll have to come with the next 3.5 release regardless, that will happen > later as needed. I think we should just get it in soonish to enable that if > needed. > > > > On Mon, Mar 24, 2025, 12:14 PM Bjørn Jørgensen <bjornjorgen...@gmail.com> > wrote: > >> Yes, I did make that PR a long time ago. It was merged on 20.11.2023. >> >> I can backport it.. it is only changing - to _ but I don't think that we >> have anyone to make a new spark version 3.5.X today and release it? >> Or do we have anyone that will make a new spark 3.5 release very soon? >> >> https://github.com/apache/spark/pull/50369 >> <https://github.com/apache/spark/pull/50369> >> >> man. 24. mars 2025 kl. 17:32 skrev Sean Owen <sro...@apache.org>: >> >>> I think we're about to hear about this: >>> >>> setuptools 78.0.0, released yesterday, no longer allows dashes in keys >>> in setup.cfg: >>> https://setuptools.pypa.io/en/stable/history.html#v78-0-0 >>> >>> The pyspark packaging has 'description-file' instead of >>> 'description_file' in its setup.cfg, and so will not install. >>> >>> This was addressed for Spark 4.0 in >>> https://issues.apache.org/jira/browse/SPARK-45994 >>> I think this just needs to be backported, but, it'll be kind of >>> unfortunate because older releases won't install, I think. >>> >>> >>> >> >> -- >> Bjørn Jørgensen >> Vestre Aspehaug 4, 6010 Ålesund >> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >> Norge >> <https://www.google.com/maps/search/Vestre+Aspehaug+4,+6010+%C3%85lesund++Norge?entry=gmail&source=g> >> >> +47 480 94 297 >> >
