I understand that transitioning from JDK 8 to JDK 11 requires some effort from the users. However, even if we wait until version 2.0, we still encounter the same problem. I don't see the need for more time to test the discontinuation of JDK 8 support. The configuration of Spark 3.5 with JDK 11 and JDK 17 is very stable, and the majority of users are using this setting. Therefore, it seems to me that we don't need to wait more time to drop JDK 8 support.
With that said, I don't have an extremely strong opinion on this matter. For Spark 4.0 support, I can change the spark-ci to only run Java 17 for Spark 4.0. However, I probably need to drop a couple of Java 8 CIs because they don't work with Spark 4.0. Thanks, Huaxin On Tue, Jul 23, 2024 at 8:11 PM Manu Zhang <owenzhang1...@gmail.com> wrote: > Yes, I'm asking for users who use JDK 8 with Spark 3.5. Users can continue > to use 1.6+ with Spark 3.5 and JDK 8 if we continue to support them. > If we drop JDK 8 support after 1.6, then there might be issues for Spark > 3.5 with JDK 8 users. > > I'm +1 to drop JDK 8 support in 2.0. I think it's worth more discussion > and tests for dropping JDK 8 support in 1.6+ versions, which can be another > thread. > > On Wed, Jul 24, 2024 at 10:45 AM huaxin gao <huaxin.ga...@gmail.com> > wrote: > >> Hi Manu, >> Thanks for the discussion. Is your concern about customers who use JDK 8 >> with Spark 3.5? But we will face the same problem if we drop JDK 8 in >> Iceberg 2.0, unless we plan to drop Spark 3.5 support in 2.0. >> >> Huaxin >> >> On Tue, Jul 23, 2024 at 7:30 PM Renjie Liu <liurenjie2...@gmail.com> >> wrote: >> >>> Hi, Manu: >>> >>> > If we drop JDK 8 support in 1.7, can Iceberg 1.7+ work seamlessly with >>> Spark 3.5? Otherwise, users might get stuck in 1.6. >>> >>> I think spark 3.5 supports JDK 8/11/17 according to their doc. So users >>> could still use iceberg 1.7+ after upgrading JDK. >>> >>> On Wed, Jul 24, 2024 at 9:40 AM Manu Zhang <owenzhang1...@gmail.com> >>> wrote: >>> >>>> Not sure about other engines but Spark has JDK 8 support till 3.5, >>>> which looks like a LTS version. >>>> If we drop JDK 8 support in 1.7, can Iceberg 1.7+ work seamlessly with >>>> Spark 3.5? Otherwise, users might get stuck in 1.6. >>>> >>>>>
