Re: Confusion over how to deploy/run JAR files to a Spark Cluster

2014-10-02 Thread Mark Mandel
On 2 October 2014 21:38, Marius Soutier wrote: > > On 02.10.2014, at 13:32, Mark Mandel wrote: > > How do I store a JAR on a cluster? Is that through storm-submit with a > deploy mode of "cluster” ? > > > Well, just upload it? scp, ftp, and so on. Ideally your build server would > put it there.

Re: Confusion over how to deploy/run JAR files to a Spark Cluster

2014-10-02 Thread Ashish Jain
Hello Mark, I am no expert but I can answer some of your questions. On Oct 2, 2014 2:15 AM, "Mark Mandel" wrote: > > Hi, > > So I'm super confused about how to take my Spark code and actually deploy and run it on a cluster. > > Let's assume I'm writing in Java, and we'll take a simple example su

Re: Confusion over how to deploy/run JAR files to a Spark Cluster

2014-10-02 Thread Marius Soutier
On 02.10.2014, at 13:32, Mark Mandel wrote: > How do I store a JAR on a cluster? Is that through storm-submit with a deploy > mode of "cluster” ? Well, just upload it? scp, ftp, and so on. Ideally your build server would put it there. > How do I run an already uploaded JAR with spark-submi

Confusion over how to deploy/run JAR files to a Spark Cluster

2014-10-02 Thread Mark Mandel
Hi, So I'm super confused about how to take my Spark code and actually deploy and run it on a cluster. Let's assume I'm writing in Java, and we'll take a simple example such as: https://github.com/apache/spark/blob/master/examples/src/main/java/org/apache/spark/examples/JavaLogQuery.java, and thi