I was getting NullPointerException when trying to call SparkSQL from
foreach. After debugging, i got to know spark session is not available in
executor and could not successfully pass it.
What i am doing is tablesRDD.foreach.collect() and it works but goes
sequential
On Mon, Jul 17, 2017 at 5:58
I did threading but got many failed tasks and they were not reprocessed. I
am guessing driver lost track of threaded tasks. I had also tired Future
and par of scala and same result as above
On Mon, Jul 17, 2017 at 5:56 PM, Pralabh Kumar
wrote:
> Run the spark context in multithreaded way .
>
> S