Re: flink no class found error

2016-08-29 Thread Robert Metzger
Hi, this page explains how to relocate classes in a fat jar: https://maven.apache.org/plugins/maven-shade-plugin/examples/class-relocation.html Regards, Robert On Wed, Aug 10, 2016 at 10:31 PM, Janardhan Reddy < janardhan.re...@olacabs.com> wrote: > We don't use guava directly, we use another l

Re: flink no class found error

2016-08-10 Thread Janardhan Reddy
We don't use guava directly, we use another library which uses guava internally? How do we use shade plugin in this case. On Thu, Aug 11, 2016 at 1:37 AM, Janardhan Reddy < janardhan.re...@olacabs.com> wrote: > I have cross checked that all our yarn nodes have 1.8 java installed but > still we ar

Re: flink no class found error

2016-08-10 Thread Janardhan Reddy
I have cross checked that all our yarn nodes have 1.8 java installed but still we are getting the error : Unsupported major.minor version 52.0 On Thu, Aug 11, 2016 at 1:35 AM, Janardhan Reddy < janardhan.re...@olacabs.com> wrote: > can you please explain a bit more about last option. We are using

Re: flink no class found error

2016-08-10 Thread Janardhan Reddy
can you please explain a bit more about last option. We are using yarn so guava might be in some classpath. On Thu, Aug 11, 2016 at 1:29 AM, Robert Metzger wrote: > Can you check if the jar you are submitting to the cluster contains a > different Guava than you use at compile time? > > Also, it

Re: flink no class found error

2016-08-10 Thread Robert Metzger
Can you check if the jar you are submitting to the cluster contains a different Guava than you use at compile time? Also, it might happen that Guava is in your classpath, for example one some YARN setups. The last resort to resolve these issues is to use the maven-shade-plugin and relocated the g

Re: flink no class found error

2016-08-10 Thread Janardhan Reddy
#1 is thrown from user code. We use hadoop 2.7 which uses gauva 11.2 but our application uses 18.0. I think the hadoop's gauva is getting picked up instead of ours On Thu, Aug 11, 2016 at 1:24 AM, Robert Metzger wrote: > Hi Janardhan, > > #1 Is the exception thrown from your user code, or from

Re: flink no class found error

2016-08-10 Thread Robert Metzger
Hi Janardhan, #1 Is the exception thrown from your user code, or from Flink? #2 is most likely caused due to a compiler / runtime version mismatch: http://stackoverflow.com/questions/10382929/how-to-fix-java-lang-unsupportedclassversionerror-unsupported-major-minor-versi You compiled the code wit

flink no class found error

2016-08-10 Thread Janardhan Reddy
Hi, We are getting the following error on submitting the flink jobs to the cluster. 1. Caused by: java.lang.NoSuchMethodError: com.google.common.io.Resources.asCharSource 2. This is for entirely different job Caused by: java.lang.UnsupportedClassVersionError: com/olacabs/fabric/common/Metadata :