Driver and Executor on the same machine

2015-06-20 Thread DStrip
I am using Spark Standalone mode to deploy a Spark cluster (Spark v.1.2.1) on 3 machines. The cluster is as follows: Machine A: Spark Master + Spark Worker Machine B: Spark Worker Machine C: Spark Worker I start the spark driver from the /bin/spark-shell of the Machine A. Even though for the mach

Spark Cassandra Connector

2015-04-18 Thread DStrip
Hello, I am facing some difficulties on installing the Cassandra Spark connector. Specifically I am working on Cassandra 2.0.13 and Spark 1.2.1. I am trying to build the-create the JAR- for the connection but unfortunately I cannot "see" in which file I have to declare the dependencies libraryDe

Spark Worker IP Error

2015-04-13 Thread DStrip
I tried to start the Spark Worker using the registered IP but this error occurred: 15/04/13 21:35:59 INFO Worker: Registered signal handlers for [TERM, HUP, INT] Exception in thread "main" java.net.UnknownHostException: 10.240.92.75/: Name or service not known at java.net.Inet6AddressImpl.