Re: Loading Python libraries into Spark

2014-06-05 Thread Andrei
gt; Thank you for your help! Just to make sure I understand, when I run this > command sc.addPyFile("/path/to/yourmodule.py"), I need to be already logged > into the master node and have my python files somewhere, is that correct? > > > > -- > View this message in conte

Re: Loading Python libraries into Spark

2014-06-05 Thread mrm
spark-user-list.1001560.n3.nabble.com/Loading-Python-libraries-into-Spark-tp7059p7073.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: Loading Python libraries into Spark

2014-06-05 Thread Andrei
at 5:29 PM, mrm wrote: > Hi, > > I am new to Spark (and almost-new in python!). How can I download and > install a Python library in my cluster so I can just import it later? > > Any help would be much appreciated. > > Thanks! > > > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Loading-Python-libraries-into-Spark-tp7059.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. >

Loading Python libraries into Spark

2014-06-05 Thread mrm
-libraries-into-Spark-tp7059.html Sent from the Apache Spark User List mailing list archive at Nabble.com.