Re: what a plava !

2020-03-27 Thread Zahid Rahman
That confirms the three technologies are competing for the same space as I suspected but wasn't sure. I can focus on the APIs and not waste any unnecessary time on even looking at mesos and yarn. Backbutton.co.uk ¯\_(ツ)_/¯ ♡۶Java♡۶RMI ♡۶ Make Use Method {MUM} makeuse.org

Re: what a plava !

2020-03-27 Thread Sean Owen
Spark standalone is a resource manager like YARN and Mesos. It is specific to Spark, and is therefore simpler, as it assumes it can take over whole machines. YARN and Mesos are for mediating resource usage across applications on a cluster, which may be running more than Spark apps. On Fri, Mar 27,

Re: what a plava !

2020-03-27 Thread Zahid Rahman
OK, Thanks. issue of load balancing /Clustering: I believe if I setup clustering like so : sbin/start-master.sh sbin/start-slave spark://master:port *another machine* sbin/start-slave spark://master:port Does yarn and mesos do anything different than that ? The spark clustering setup and yarn

Re: what a plava !

2020-03-27 Thread Sean Owen
- dev@, which is more for project devs to communicate. Cross-posting is discouraged too. The book isn't from the Spark OSS project, so not really the place to give feedback here. I don't quite understand the context of your other questions, but would elaborate them in individual, clear emails ins