I use https://code.google.com/p/parallel-ssh/ to upgrade all my slaves
From: "taotao.li" <charles.up...@gmail.com> Date: Sunday, January 10, 2016 at 9:50 PM To: "user @spark" <user@spark.apache.org> Subject: pre-install 3-party Python package on spark cluster > I have a spark cluster, from machine-1 to machine 100, and machine-1 acts as > the master. > > Then one day my program need use a 3-party python package which is not > installed on every machine of the cluster. > > so here comes my problem: to make that 3-party python package usable on > master and slaves, should I manually ssh to every machine and use pip to > install that package? > > I believe there should be some deploy scripts or other things to make this > grace, but I can't find anything after googling. > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/pre-install-3-party-Python > -package-on-spark-cluster-tp25930.html > Sent from the Apache Spark User List mailing list archive at Nabble.com. > > --------------------------------------------------------------------- > To unsubscribe, e-mail: user-unsubscr...@spark.apache.org > For additional commands, e-mail: user-h...@spark.apache.org > >
