Yes, I did make that PR a long time ago. It was merged on 20.11.2023. I can backport it.. it is only changing - to _ but I don't think that we have anyone to make a new spark version 3.5.X today and release it? Or do we have anyone that will make a new spark 3.5 release very soon?
https://github.com/apache/spark/pull/50369 <https://github.com/apache/spark/pull/50369> man. 24. mars 2025 kl. 17:32 skrev Sean Owen <sro...@apache.org>: > I think we're about to hear about this: > > setuptools 78.0.0, released yesterday, no longer allows dashes in keys in > setup.cfg: > https://setuptools.pypa.io/en/stable/history.html#v78-0-0 > > The pyspark packaging has 'description-file' instead of 'description_file' > in its setup.cfg, and so will not install. > > This was addressed for Spark 4.0 in > https://issues.apache.org/jira/browse/SPARK-45994 > I think this just needs to be backported, but, it'll be kind of > unfortunate because older releases won't install, I think. > > > -- Bjørn Jørgensen Vestre Aspehaug 4, 6010 Ålesund Norge +47 480 94 297
