+1, Spark-2.4 has reached EOL ( https://lists.apache.org/thread/tdk7r5gx3nwrds3fg7qmp5h2jnqgc6tb and https://spark.apache.org/versioning-policy.html)
Thanks, Ajantha On Wed, Apr 19, 2023 at 3:52 AM Edgar Rodriguez <edgar.rodrig...@airbnb.com.invalid> wrote: > I'm generally +1 on dropping Spark 2.4 - mostly everyone is moving to > Spark 3.x, if not already moved. > > As for the Hadoop upgrade, I think that could be problematic for us if > there's any non-backwards compatible API change required at compile time > since we're still running a 2.8.x version. > > Cheers, > > On Mon, Apr 17, 2023 at 3:50 PM Steve Zhang > <hongyue_zh...@apple.com.invalid> wrote: > >> +1 for dropping Spark 2.4 support and we can clean up doc as well such as >> https://iceberg.apache.org/docs/latest/spark-queries/#spark-24 >> >> Thanks, >> Steve Zhang >> >> >> >> On Apr 13, 2023, at 12:53 PM, Jack Ye <yezhao...@gmail.com> wrote: >> >> +1 for dropping 2.4 support >> >> >> > > -- > Edgar R > Data Warehouse Infrastructure >
