Can you try increasing the partition for the base RDD/dataframe that you
are working on?
On Tue, May 8, 2018 at 5:05 PM, Debabrata Ghosh
wrote:
> Hi Everyone,
> I have been trying to run spark-shell in YARN client mode, but am getting
> lot of ClosedChannelException errors, however the program
Hi Everyone,
I have been trying to run spark-shell in YARN client mode, but am getting
lot of ClosedChannelException errors, however the program works fine on
local mode. I am using spark 2.2.0 build for Hadoop 2.7.3. If you are
familiar with this error, please can you help with the possible reso