Re: ClasNotFound when submitting job from command line

2016-04-20 Thread Flavio Pompermaier
At the moment my 2 PRs about jdbc batch connector and input format fix are pending so I have my customized implementation of the inputformat in my jar andas jdbc backend I need ijdbc6.jar as dependency (that I shade on the jar). Thus the class.forName() is called on the inputformat open(). On 20 Ap

Re: ClasNotFound when submitting job from command line

2016-04-20 Thread Robert Metzger
Hi Flavio, in which class are you calling Class.forName()? Is the class where the Class.forName() call is loaded from the user jar or is it a class from the Flink distribution? I'm asking because Class.forName() is using the classloader of the class where the call is located. So if the class has b

Re: ClasNotFound when submitting job from command line

2016-04-19 Thread Flavio Pompermaier
I use maven to generate the shaded jar (and the classes are inside it) but when the job starts it can load those classes using Class.forName() (required to instantiate the JDBC connections). I think it's probably a problem related to class loading of Flink On Tue, Apr 19, 2016 at 6:02 PM, Balaji R

Re: ClasNotFound when submitting job from command line

2016-04-19 Thread Balaji Rajagopalan
In your pom.xml add the maven.plugins like this, and you will have to add all the dependent artifacts, this works for me, if you fire mvn clean compile package, the created jar is a fat jar. org.apache.maven.plugins maven-dependency-plugin 2.9

RE: ClasNotFound when submitting job from command line

2016-04-19 Thread Radu Tudoran
other than the intended recipient(s) is prohibited. If you receive this e-mail in error, please notify the sender by phone or email immediately and delete it! From: Flavio Pompermaier [mailto:pomperma...@okkam.it] Sent: Tuesday, April 19, 2016 5:40 PM To: user Subject: ClasNotFound when submittin

ClasNotFound when submitting job from command line

2016-04-19 Thread Flavio Pompermaier
Hi to all, I just tied to dubmit my application to the Flink cluster (1.0.1) but I get ClassNotFound exceptions for classes inside my shaded jar (like oracle.jdbc.OracleDriver or org.apache.commons.pool2.PooledObjectFactory). Those classes are in the shaded jar but aren't found. If I put the jars