The build failure messages all point to the zeppelin-zengine module in the source code. In this commit: https://github.com/apache/zeppelin/commit/30bfcae0c0c9650aff3ed1f8fe41eee9c4e93cb1#diff-98784f3ef76c2907324fa9e48e66cf47 , a dependency change was made to add the org.apache.hadoop:hadoop-client which points to both org.apache.hadoop:hadoop-common and org.apache.hadoop:hadoop-hdfs. These two have dependencies upon different versions (at least for the Cloudera version of them) of the org.codehaus.jackson:jackson-mapper-asl library, 1.8.8 and 1.9.13 respectively.
Was anyone able to build zeppelin with cloudera repo after ZEPPELIN-1515. Notebook: HDFS as a backend storage (Use hadoop client jar) PR #2455 was committed ? On Mon, Dec 18, 2017 at 4:20 PM, Ruslan Dautkhanov <dautkha...@gmail.com> wrote: > We're now looking at shading option. > > Talking to Cloudera Support even minor upgrades to jackson known have > caused issues in the past. > They also said they're planning to upgrade CDH6 to jackson 2.*7*.8 - but > this will be released mid-next year. > So we're not waiting for that to happen. > > Yes, we will contribute back to the project when we find solution. > Thanks for the suggestion Felix. Is this known if Zeppelin can work fine > with jasckson 2.*2*.3? > (certain dependencies currently list jackson 2.*5*.3) > > > > -- > Ruslan Dautkhanov > > On Sat, Dec 16, 2017 at 3:03 AM, Felix Cheung <felixcheun...@hotmail.com> > wrote: > >> Instead of exclusion, would it be better to use the version in the >> cloudera repo? >> >> Please do consider contributing these changes back to Zeppelin source. >> Thanks! >> >> _____________________________ >> From: Ruslan Dautkhanov <dautkha...@gmail.com> >> Sent: Monday, December 11, 2017 3:42 PM >> Subject: Re: zeppelin build fails with DependencyConvergence error >> To: Zeppelin Users <us...@zeppelin.incubator.apache.org> >> >> >> >> Looks like master branch of Zeppelin still has compatibility issue with >> Cloudera dependencies. >> >> When built using >> >> mvn clean package -DskipTests -Pspark-2.2 -Dhadoop.version=2.6.0-cdh5.12.1 >> -Phadoop-2.6 -Pvendor-repo -pl '!...list of excluded packages' -e >> >> maven fails on jackson convergence error - see below email for more >> details. >> Looks like there was a change in Zeppelin that upgraded Jackson's >> version? >> So now it conflicts with older jackson library as referenced by cloudera >> repo. >> >> workaround: Zeppelin builds fine with pom change [1] - the question is >> now >> would somebody expect Zeppelin would still be functioning correctly with >> these exclusions? >> >> >> >> [1] >> >> --- a/zeppelin-zengine/pom.xml >>> +++ b/zeppelin-zengine/pom.xml >>> @@ -364,6 +364,30 @@ >>> <groupId>com.google.guava</groupId> >>> <artifactId>guava</artifactId> >>> </exclusion> >>> + <exclusion> >>> + <groupId>com.fasterxml.jackson.core</groupId> >>> + <artifactId>jackson-core</artifactId> >>> + </exclusion> >>> + <exclusion> >>> + <groupId>com.fasterxml.jackson.core</groupId> >>> + <artifactId>jackson-annotations</artifactId> >>> + </exclusion> >>> + <exclusion> >>> + <groupId>com.fasterxml.jackson.core</groupId> >>> + <artifactId>jackson-databind</artifactId> >>> + </exclusion> >>> + <exclusion> >>> + <groupId>org.codehaus.jackson</groupId> >>> + <artifactId>jackson-mapper-asl</artifactId> >>> + </exclusion> >>> + <exclusion> >>> + <groupId>org.codehaus.jackson</groupId> >>> + <artifactId>jackson-core-asl</artifactId> >>> + </exclusion> >>> + <exclusion> >>> + <groupId>org.apache.zookeeper</groupId> >>> + <artifactId>zookeeper</artifactId> >>> + </exclusion> >>> </exclusions> >>> </dependency> >>> >> >> >> >> On Sun, Aug 27, 2017 at 2:25 PM, Ruslan Dautkhanov <dautkha...@gmail.com> >> wrote: >> >>> Building from a current Zeppelin snapshot fails with >>> zeppelin build fails with org.apache.maven.plugins.enfor >>> cer.DependencyConvergence >>> see details below. >>> >>> Build command >>> /opt/maven/maven-latest/bin/mvn clean package -DskipTests -Pspark-2.2 >>> -Dhadoop.version=2.6.0-cdh5.12.0 -Phadoop-2.6 -Pvendor-repo >>> -Pscala-2.10 -Psparkr -pl '!*..excluded certain modules..*' -e >>> >>> maven 3.5.0 >>>> jdk 1.8.0_141 >>>> RHEL 7.3 >>>> npm.x86_64 1:3.10.10-1.6.11.1.1.el7 >>>> nodejs.x86_64 1:6.11.1-1.el7 @epel >>>> latest zeppelin snapshot >>> >>> >>> Any ideas? It's my first attempt to build on rhel7/jdk8 .. never seen >>> this problem before. >>> >>> Thanks, >>> Ruslan >>> >>> >>> >>> [INFO] Scanning for projects... >>> [WARNING] >>> [WARNING] Some problems were encountered while building the effective >>> model for org.apache.zeppelin:zeppelin-spark-dependencies_2.10:jar:0.8 >>> .0-SNAPSHOT >>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>> but found duplicate declaration of plugin >>> com.googlecode.maven-download-plugin:download-maven-plugin >>> @ line 940, column 15 >>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>> but found duplicate declaration of plugin >>> com.googlecode.maven-download-plugin:download-maven-plugin >>> @ line 997, column 15 >>> [WARNING] >>> [WARNING] Some problems were encountered while building the effective >>> model for org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT >>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>> but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin >>> @ line 467, column 15 >>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>> but found duplicate declaration of plugin >>> org.apache.maven.plugins:maven-surefire-plugin >>> @ line 475, column 15 >>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>> but found duplicate declaration of plugin >>> org.apache.maven.plugins:maven-compiler-plugin >>> @ line 486, column 15 >>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>> but found duplicate declaration of plugin org.scala-tools:maven-scala-plugin >>> @ line 496, column 15 >>> [WARNING] 'build.plugins.plugin.(groupId:artifactId)' must be unique >>> but found duplicate declaration of plugin >>> org.apache.maven.plugins:maven-surefire-plugin >>> @ line 504, column 15 >>> [WARNING] >>> [WARNING] It is highly recommended to fix these problems because they >>> threaten the stability of your build. >>> [WARNING] >>> [WARNING] For this reason, future Maven versions might no longer support >>> building such malformed projects. >>> [WARNING] >>> [WARNING] The project org.apache.zeppelin:zeppelin-web:war:0.8.0-SNAPSHOT >>> uses prerequisites which is only intended for maven-plugin projects but not >>> for non maven-plugin projects. For such purposes you should use the >>> maven-enforcer-plugin. See https://maven.apache.org/enfor >>> cer/enforcer-rules/requireMavenVersion.html >>> >>> >>> ... [skip] >>> >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] Building Zeppelin: Zengine 0.8.0-SNAPSHOT >>> [INFO] ------------------------------------------------------------ >>> ------------ >>> [INFO] >>> [INFO] --- maven-clean-plugin:2.6.1:clean (default-clean) @ >>> zeppelin-zengine --- >>> [INFO] >>> [INFO] --- flatten-maven-plugin:1.0.0:clean (flatten.clean) @ >>> zeppelin-zengine --- >>> [INFO] >>> [INFO] --- maven-checkstyle-plugin:2.13:check (checkstyle-fail-build) @ >>> zeppelin-zengine --- >>> [INFO] >>> [INFO] >>> [INFO] --- maven-resources-plugin:2.7:copy-resources (copy-resources) @ >>> zeppelin-zengine --- >>> [INFO] Using 'UTF-8' encoding to copy filtered resources. >>> [INFO] Copying 17 resources >>> [INFO] >>> [INFO] --- maven-enforcer-plugin:1.3.1:enforce (enforce) @ >>> zeppelin-zengine --- >>> [WARNING] >>> Dependency convergence error for >>> com.fasterxml.jackson.core:jackson-core:2.5.3 >>> paths to dependency are: >>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>> +-com.amazonaws:aws-java-sdk-s3:1.10.62 >>> +-com.amazonaws:aws-java-sdk-core:1.10.62 >>> +-com.fasterxml.jackson.core:jackson-databind:2.5.3 >>> +-com.fasterxml.jackson.core:jackson-core:2.5.3 >>> and >>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>> +-org.apache.hadoop:hadoop-aws:2.6.0-cdh5.12.0 >>> +-com.fasterxml.jackson.core:jackson-core:2.2.3 >>> >>> [WARNING] >>> Dependency convergence error for >>> org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>> paths to dependency are: >>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>> +-com.github.eirslett:frontend-maven-plugin:1.3 >>> +-com.github.eirslett:frontend-plugin-core:1.3 >>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>> and >>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>> +-org.apache.hadoop:hadoop-common:2.6.0-cdh5.12.0 >>> +-org.codehaus.jackson:jackson-mapper-asl:1.8.8 >>> and >>> +-org.apache.zeppelin:zeppelin-zengine:0.8.0-SNAPSHOT >>> +-org.apache.hadoop:hadoop-client:2.6.0-cdh5.12.0 >>> +-org.apache.hadoop:hadoop-hdfs:2.6.0-cdh5.12.0 >>> +-org.codehaus.jackson:jackson-mapper-asl:1.9.13 >>> >>> ... [skipped a number of other version convergence errors for >>> dependencies] >>> >>> >>> >> >> >> >
