Re: spark sql OOM

2015-10-14 Thread Andy Zhao
I increased executor memory from 6g to 10g, but it still failed and report the same error and because of my company security policy, I cannot write the sql out. But I'm sure that this error occurred in the compute method of HadoopRDD, and this error happened in one of executors. -- View this me

Re: spark sql OOM

2015-10-14 Thread cherrywayb...@gmail.com
Hi,pls increase your memory . cherrywayb...@gmail.com From: Andy Zhao Date: 2015-10-14 17:40 To: user Subject: spark sql OOM Hi guys, I'm testing sparkSql 1.5.1, and I use hadoop-2.5.0-cdh5.3.2. One sql which can ran successfully using hive failed when I ran it using sparkSql. I got the f

Re: spark sql OOM

2015-10-14 Thread Fengdong Yu
Can you search the mail-archive before asked the question? at least search for how ask the question. nobody can give your answer if you don’t paste your SQL or SparkSQL code. > On Oct 14, 2015, at 17:40, Andy Zhao wrote: > > Hi guys, > > I'm testing sparkSql 1.5.1, and I use hadoop-2.5.0-cd