Thank you for the reply. I am using zip files for now.
Documentation for 1.5.2 mentions use of zip files or eggs, maybe a
'note' that tar's are not supported might be helpful to some.
https://spark.apache.org/docs/latest/submitting-applications.html
Best Regards,
Praveen
On 14.11.2015 00:40, Davies Liu wrote:
Python does not support library as tar balls, so PySpark may also not
support that.
On Wed, Nov 4, 2015 at 5:40 AM, Praveen Chundi <mail.chu...@gmail.com> wrote:
Hi,
Pyspark/spark-submit offers a --py-files handle to distribute python code
for execution. Currently(version 1.5) only zip files seem to be supported, I
have tried distributing tar balls unsuccessfully.
Is it worth adding support for tar balls?
Best regards,
Praveen Chundi
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
