Executor unable to pick postgres driver in Spark standalone cluster

Hi all, I was submitting the play application to spark 2.1 standalone cluster . In play application postgres dependency is also added and application works on local spark libraries. But at run time on standalone cluster it gives me error : o.a.s.s.TaskSetManager - Lost task 0.0 in stage 0.0 (TI

Re: About transformations

Hi, Spark is very efficeint in SQL because of https://databricks.com/blog/2015/04/28/project-tungsten-bringing-spark-closer-to-bare-metal.html you can see all the metrics of your all the transforma

Re: took more time to get data from spark dataset to driver program

Again if you run spark cluster in standalone mode with optimum number of executors with balanced cores and memory configuration, it will run faster as more parallel operations took place. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/took-more-time-to-ge

Re: Newbie question - Best way to bootstrap with Spark

Integrate spark with apache zeppelin https://zeppelin.apache.org/ its again a very handy way to bootstrap with spark. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Newbie-question-Best-way-to-bootstrap-with-Spark-tp28032p2