I increased executor memory from 6g to 10g, but it still failed and report
the same error and because of my company security policy, I cannot write the
sql out. But I'm sure that this error occurred in the compute method of
HadoopRDD, and this error happened in one of executors.
--
View this me
Hi,pls increase your memory .
cherrywayb...@gmail.com
From: Andy Zhao
Date: 2015-10-14 17:40
To: user
Subject: spark sql OOM
Hi guys,
I'm testing sparkSql 1.5.1, and I use hadoop-2.5.0-cdh5.3.2.
One sql which can ran successfully using hive failed when I ran it using
sparkSql.
I got the f
Can you search the mail-archive before asked the question? at least search for
how ask the question.
nobody can give your answer if you don’t paste your SQL or SparkSQL code.
> On Oct 14, 2015, at 17:40, Andy Zhao wrote:
>
> Hi guys,
>
> I'm testing sparkSql 1.5.1, and I use hadoop-2.5.0-cd