Like Linkedin (mentioned in another thread), Pinterest is on Spark 3.2 and there is no immediate plan to upgrade to the new Spark version as the migration cost is very high and the process is slow.
What will be the implications of not having Spark-3.2 module in Iceberg any more? Based on your past experience, how do companies move forward to maintain Iceberg with removed Spark versions? Do those companies own their enhancements or fixes internally? Thanks! On Wed, Sep 20, 2023 at 4:00 PM Ryan Blue <b...@tabular.io> wrote: > +1 > > On Wed, Sep 20, 2023 at 3:02 PM Anton Okolnychyi > <aokolnyc...@apple.com.invalid> wrote: > >> Shall we consider deprecating our Spark 3.2 support? That Spark version >> is no longer being maintained by the Spark community and is not under >> active development in Iceberg. It was released in October, 2021 and passed >> the 18 month maintenance mark in Spark. >> >> - Anton > > > > -- > Ryan Blue > Tabular >
