Hi All I am trying to cache large dataset with storage level memory and sterilization with kyro enabled when I run my spark job multiple times I get different performance at a times caching dataset spark hangs and takes forever what is wrong.
The best time I got is 20 mins and some times with same configuration it takes 40 mins why this is happening ? Best Regards, Anil Langote +1-425-633-9747
