Additionally, found that there is no community consensus regarding YARN and Java 9, 10, 11. There is conversation about supporting Java 11 in version YARN 3.3
Confluence link with relevant Jira tickets: https://cwiki.apache.org/confluence/display/HADOOP/Hadoop+and+Java+9%2C+10%2C+11 Jeremiah Adams Software Engineer www.helixeducation.com Blog | Twitter | Facebook | LinkedIn ________________________________________ From: Jeremiah Adams <jad...@helixeducation.com> Sent: Tuesday, October 2, 2018 12:55 PM To: dev@samza.apache.org Subject: [POSSIBLE PHISHING] Re: Open JDK 11 Early Results I am trying both building from the (Samza) source and attempting to run the pre-built binaries. YARN is a blocker as nodemanager/resourcemanager will not run at all. It is an issue with Java11 removing J2EE artifacts. I will be sending the yarn-dev group a message regarding the problem. I also didn't see anything about Java11 in YARN's JIRA. I've had no traction with YARN as of yet. Zookeeper devs fixed the tests that were broken in Java 11 and will go out in some future release. Kafka has JIRA tasks for supporting Java11. https://url.emailprotection.link/?aXbNFujPDP4Cfs-6OQ7jlf8T9J_NulRd7SGvkTYwMFSBSs8xuTBKzTMBG5jwB2lC5xKfWqt-aRh_ULiYoVt2UqBnR9hdRHYEVGQPxlpwxWt6M4Xs1csoS-CD5liEblOHaQu7rCAwM5hArmZszPVduBeMHaHMz8V7XwAOqm8DN1ls~ Jeremiah Adams Software Engineer https://url.emailprotection.link/?ahfhEufaAWbezBrUFPG98ZJcterGfIerU3ZwsA3Gv_C0~ Blog | Twitter | Facebook | LinkedIn ________________________________________ From: Yi Pan <nickpa...@gmail.com> Sent: Tuesday, October 2, 2018 11:16 AM To: dev@samza.apache.org Subject: Re: Open JDK 11 Early Results Hi, Jeremiah, Thanks for the detailed report! Really appreciate it! So, from the report, it seems that we need to track the issues separately: 1) OpenJDK 11 with YARN (xxx version is to be determined pending feature and backward compatibility tests) 2) OpenJDK 11 with Kafka (xxx version is to be determined pending feature and backward compatibility tests) 3) Samza gradle build failed with OpenJDK 11 Questions: 1) When you are doing the YARN/Kafka + OpenJDK11 tests, are you just using OpenJDK 11 JVM to run the binaries? Have you tried to build from the source code? 2) I am curious what other open source projects' strategy on OpenJDK11? Or are all the other communities decide to pay Oracle for JE 11? In YARN JIRA board, I can only find a few tickets with OpenJDK 7 or 8. Are AYRN and Kafka community only supporting OpenJDK 7 and 8 now? -Yi On Mon, Oct 1, 2018 at 3:43 PM Jeremiah Adams <jad...@helixeducation.com> wrote: > Samza master branch does not build on Open JDK 11. It fails with a Gradle > issue. Opened an issue with Gradle here: > https://url.emailprotection.link/?aZyQRg2CGut2qgyHrdHxA3qV_YdEkDcofcS3Ip-n59fO1mYzzqT_kSmrqYWJKqnJe-eAyIfh5joJFOTohULoTkQ~~ > > ”Could not determine java version from '11'.” > > I Tried running all the dependencies in Hello-Samza via Grid. Yarn behaved > as I expected and did not start. It is likely that Yarn is the biggest > risk. > > Hadoop-2.6.1 - does not start on Open JDK 11 > Kafka-2.11-0.10.2.1 - does not start on Open JDK 11 > Zookeeper-3.4.3 - starts on Open JDK 11 > > > I updated Grid to recent versions and Yarn continued to misbehave: > > Hadoop: 3.1.1 - Does not start on Open JDK 11 > Kafka: - 2.11-2.0.0 - Starts on Open JDK 11 > Zookeeper: 3.4.13 - Starts on Open JDK 11 > > I can’t really test anything interesting until Yarn can play nice on JDK > 11. > > > > Jeremiah Adams > Software Engineer > https://url.emailprotection.link/?ahfhEufaAWbezBrUFPG98ZJcterGfIerU3ZwsA3Gv_C0~ > Blog | Twitter | Facebook | LinkedIn > > ________________________________________ > From: Yi Pan <nickpa...@gmail.com> > Sent: Tuesday, September 25, 2018 9:09 AM > To: dev@samza.apache.org > Subject: Re: Java 11, Oracle Java and OpenJDK Release Cadence > > Hey, Jeremiah, > > Sorry to reply late. The team is pretty busy for Samza 1.0 preparation > these days. > > Regarding to Java 11 and the steps forward: > 1. I don't have objection to adopt OpenJDK, as long as Samza code and > compile and run on it. It might be an interesting issue since Samza also > depends on other open source projects (like ZooKeeper and Kafka) which may > not be test w/ OpenJDK yet. > 2. It would be great if you can have some test build/run of Samza with Java > 11 (I assume with OpenJDK?) and report the results back to the community > 3. We can start a formal poll and vote when we know what it takes to adopt > OpenJDK > > Does that sound good to you? Thanks! > > -Yi > >
