Re: Issues when combining Spark and a third party java library

2015-07-12 Thread Max Demoulin
version for hadoop 2.4 >> and higher from the official website. >> >> >> >> -- >> View this message in context: >> http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367p23770.

Re: Issues when combining Spark and a third party java library

2015-07-11 Thread Akhil Das
ext: > http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367p23770.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --

Re: Issues when combining Spark and a third party java library

2015-07-10 Thread maxdml
Also, it's worth noting that I'm using the prebuilt version for hadoop 2.4 and higher from the official website. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367p23770.html Sen

Re: Issues when combining Spark and a third party java library

2015-07-10 Thread maxdml
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala) The application I launch through spark-submit can access data on hdfs tho, and I launch the script with HADOOP_HOME being set. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-

Re: Issues when combining Spark and a third party java library

2015-01-27 Thread Staffan
Okay, I finally tried to change the Hadoop-client version from 2.4.0 to 2.5.2 and that mysteriously fixed everything.. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367p21387.html Sent from

Re: Issues when combining Spark and a third party java library

2015-01-27 Thread Staffan
ues running his Spark and Hadoop applications on his machine while using the same VM. (So all the issues seems to pop up by just introducing a new dependency in the project). -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-t

Re: Issues when combining Spark and a third party java library

2015-01-26 Thread Akhil Das
> > > After testing different versions of both CDK and Spark, I've found out that > the Spark version 0.9.1 and earlier DO NOT have this problem, so there is > something in the newer versions of Spark that do not play well with > others... However, I need the functionality i

Issues when combining Spark and a third party java library

2015-01-26 Thread Staffan
penscience.cdk cdk-fingerprint 1.5.10 -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Issues-when-combining-Spark-and-a-third-party-java-library-tp21367.html Sent from the Apache Spark User List mail