Re: Adding third party jars to classpath used by pyspark

2014-12-30 Thread Davies Liu
On Mon, Dec 29, 2014 at 7:39 PM, Jeremy Freeman wrote: > Hi Stephen, it should be enough to include > >> --jars /path/to/file.jar > > in the command line call to either pyspark or spark-submit, as in > >> spark-submit --master local --jars /path/to/file.jar myfile.py Unfortunately, you also need

Re: Adding third party jars to classpath used by pyspark

2014-12-29 Thread Jeremy Freeman
Hi Stephen, it should be enough to include > --jars /path/to/file.jar in the command line call to either pyspark or spark-submit, as in > spark-submit --master local --jars /path/to/file.jar myfile.py and you can check the bottom of the Web UI’s “Environment" tab to make sure the jar gets on