Hi, I have a question that I really have problems with figuring out for myself:
Does the master node in a spark cluster need to be a node similar to the slave nodes or should I rather view it as a coordinating node, that does not need much computing or storage power? For example, when using Spark Streaming and Checkpointing, would the master node need access to the shared file system (e.g. HDFS)? Or do I only need to mount that on the slaves? (likewise, if I use the Cassandra-Connector, does that (and C*) need to be installed on the master node, too?) Or, in other words: is the master just one node of similar cluster nodes, or is it merely a 'small control node', for which sort of any small VM would do? Jan --------------------------------------------------------------------- To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org
