Re: Spark SQL with Thrift Server is very very slow and finally failing

2015-06-10 Thread Cheng Lian
<mailto:yuzhih...@gmail.com>] *Sent:* Tuesday, June 9, 2015 12:01 PM *To:* Sourav Mazumder *Cc:* user *Subject:* Re: Spark SQL with Thrift Server is very very slow and finally failing Which Spark release are you using ?

Re: Spark SQL with Thrift Server is very very slow and finally failing

2015-06-10 Thread Sourav Mazumder
e from the machine where the thrift process is >> running. >> >> Regards, >> Sourav >> >> On Mon, Jun 8, 2015 at 11:18 PM, Cheng, Hao wrote: >> >>> Is it the large result set return from the Thrift Server? And can you >>&

Re: Spark SQL with Thrift Server is very very slow and finally failing

2015-06-10 Thread Cheng Lian
rift Server? And can you paste the SQL and physical plan? *From:*Ted Yu [mailto:yuzhih...@gmail.com <mailto:yuzhih...@gmail.com>] *Sent:* Tuesday, June 9, 2015 12:01 PM *To:* Sourav Mazumder *Cc:* user *Subject:* Re: Spark SQL with Thr

Re: Spark SQL with Thrift Server is very very slow and finally failing

2015-06-09 Thread Sourav Mazumder
, Jun 8, 2015 at 11:18 PM, Cheng, Hao wrote: > >> Is it the large result set return from the Thrift Server? And can you >> paste the SQL and physical plan? >> >> >> >> *From:* Ted Yu [mailto:yuzhih...@gmail.com] >> *Sent:* Tuesday, June 9, 2

RE: Spark SQL with Thrift Server is very very slow and finally failing

2015-06-08 Thread Cheng, Hao
Is it the large result set return from the Thrift Server? And can you paste the SQL and physical plan? From: Ted Yu [mailto:yuzhih...@gmail.com] Sent: Tuesday, June 9, 2015 12:01 PM To: Sourav Mazumder Cc: user Subject: Re: Spark SQL with Thrift Server is very very slow and finally failing

Re: Spark SQL with Thrift Server is very very slow and finally failing

2015-06-08 Thread Ted Yu
Which Spark release are you using ? Can you pastebin the stack trace w.r.t. ExecutorLostFailure ? Thanks On Mon, Jun 8, 2015 at 8:52 PM, Sourav Mazumder wrote: > Hi, > > I am trying to run a SQL form a JDBC driver using Spark's Thrift Server. > > I'm doing a join between a Hive Table of size a