Re: Unable to ship external Python libraries in PYSPARK

Is there some way to ship textfile just like ship python libraries？ Thanks in advance Daijia -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Unable-to-ship-external-Python-libraries-in-PYSPARK-tp14074p14412.html Sent from the Apache Spark User List mailing

Re: Fwd: pyspark crash on mesos

I met the same problem. Do you have some solution? Thanks Daijia -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Fwd-pyspark-crash-on-mesos-tp2256p5.html Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: How to submit Pyspark job in mesos?

r gc 6.8881231704days in the future I0730 16:57:21.966872 20042 slave.cpp:2273] Cleaning up framework 20140730-165621-1526966464-5050-23977- I0730 16:57:21.967042 20049 gc.cpp:56] Scheduling '/tmp/mesos/slaves/20140730-154530-1526966464-5050-22832-1/frameworks/20140730-165621-1526966

Re: How to submit Pyspark job in mesos?

Actually, it runs okay in my slaves deployed by standalone mode. When I switch to mesos, the error just occurs. Anyway, thanks for your reply and any ideas will help. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/How-to-submit-Pyspark-job-in-mesos-tp10

How to submit Pyspark job in mesos?

library for your platform... using builtin-java classes where applicable 14/07/29 18:40:50 INFO scheduler.EventLoggingListener: Logging events to /tmp/spark-events/my_test.py-1406630449771 14/07/29 18:40:50 INFO util.Utils: Copying /home/daijia/deal_three_word/my_test.py to /tmp/spark-4365b01d-b57a