Re: Shading Plugin + Hadoop Dependency

2016-06-24 Thread vijikarthi
se the filter ( -Dtest=YARNSessionFIFOITCase#testJavaAPI ) to run specific test case. P.S: I have also noticed the surefile plugin is not stable and sometimes it throws some wierd issues which is very difficult to debug. Regards Vijay -- View this message in context: http://apache-flink-mail

Re: Shading Plugin + Hadoop Dependency

2016-06-23 Thread Vijay Srinivasaraghavan
Hi Rob, I ran the build and now I could see the minikdc classes bundled in "flink-shaded-include-yarn-tests/target/flink-shaded-include-yarn-tests-1.1-SNAPSHOT.jar" location. cd /workspace/git-projects/flink/flink-shaded-hadoop/flink-shaded-include-yarn-tests $ jar tf target/flink-shaded-includ

Re: Shading Plugin + Hadoop Dependency

2016-06-21 Thread Robert Metzger
Hi, This this is how I did it: robert@robert-da ...adoop/flink-shaded-include-yarn-tests (git)-[master] % pwd /home/robert/incubator-flink/flink-shaded-hadoop/flink-shaded-include-yarn-tests robert@robert-da ...adoop/flink-shaded-include-yarn-tests (git)-[master] % mvn clean install [INFO] Scann

Re: Shading Plugin + Hadoop Dependency

2016-06-21 Thread Vijay Srinivasaraghavan
Thanks Rob for trying. In my machine, I don't see any of minikdc related files in the target jar. How did you run the build? RegardsVijay On Tuesday, June 21, 2016 8:39 AM, Robert Metzger wrote: Cool, thank you. After adding the line you've mentioned, my jar contains the missing MiniKd

Re: Shading Plugin + Hadoop Dependency

2016-06-21 Thread Robert Metzger
Cool, thank you. After adding the line you've mentioned, my jar contains the missing MiniKdc class: robert@robert-da ...adoop/flink-shaded-include-yarn-tests (git)-[master] % jar tf target/flink-shaded-include-yarn-tests-1.1-SNAPSHOT.jar | grep minikdc minikdc-krb5.conf minikdc.ldiff org/apache/h

Re: Shading Plugin + Hadoop Dependency

2016-06-21 Thread Vijay Srinivasaraghavan
Hi Rob, You need to include below lines to the pom.xml to resolve the chain dependency error. org.apache.felix maven-bundle-plugin true true RegardsVijay On Tuesday, June 21, 2016 8:27 AM, Robert Metzger wrote: Hi, I didn't even get the shading module to build: [INFO] -

Re: Shading Plugin + Hadoop Dependency

2016-06-21 Thread Robert Metzger
Hi, I didn't even get the shading module to build: [INFO] [INFO] Building flink-shaded-include-yarn-tests 1.1-SNAPSHOT [INFO] [INFO] --

Re: Shading Plugin + Hadoop Dependency

2016-06-21 Thread Vijay Srinivasaraghavan
Hi Rob, Yes I checked but the result jar does not contain the classes from hadoop-minikdc package. RegardsVijay On Tuesday, June 21, 2016 7:59 AM, Robert Metzger wrote: Hi Vijay, did you check if the artifact produced by the "flink-shaded-include-yarn-tests" module contains the requir

Re: Shading Plugin + Hadoop Dependency

2016-06-21 Thread Robert Metzger
Hi Vijay, did you check if the artifact produced by the "flink-shaded-include-yarn-tests" module contains the required classes? Regards, Robert On Mon, Jun 20, 2016 at 6:18 PM, Vijay Srinivasaraghavan < vijikar...@yahoo.com.invalid> wrote: > Hello, > I was trying to include "hadoop-minikdc" co

Shading Plugin + Hadoop Dependency

2016-06-20 Thread Vijay Srinivasaraghavan
Hello, I was trying to include "hadoop-minikdc" component to Yarn test framework by adding the dependency in "flink-shaded-include-yarn-tests" pom.xml file. org.apache.hadoop hadoop-minikdc ${hadoop.version} The dependency inclusion seems to be working from IDE. IntelliJ picked up the