To clarify I tried it and it almost worked -- but I am getting some problems from the Random module in numpy. If anyone has successfully passed a numpy module (via the --py-files option) to spark-submit then please let me know.
Thanks !! Avishek On 26 June 2014 17:45, Avishek Saha <avishek.s...@gmail.com> wrote: > Hi all, > > Instead of installing numpy in each worker node, is it possible to > ship numpy (via --py-files option maybe) while invoking the > spark-submit? > > Thanks, > Avishek >
