Re: java.util.NoSuchElementException: Columns not found

2019-06-03 Thread Shyam P
Thank you so much Alex Ott. On Fri, May 31, 2019 at 6:05 PM Alex Ott wrote: > Check the answer on SO... > > On Fri, May 31, 2019 at 1:04 PM Shyam P wrote: > >> Trying to save a sample data into C* table >> >> I am getting below error : >> >> *java.util.NoSuchElementException: Columns not found

Re: Should python-2 be supported in Spark 3.0?

2019-06-03 Thread Xiangrui Meng
I updated Spark website and announced the plan for dropping python 2 support there: http://spark.apache.org/news/plan-for-dropping-python-2-support.html. I will send an announcement email to user@ and dev@. -Xiangrui On Fri, May 31, 2019 at 10:54 PM Felix Cheung wrote: > Very subtle but someone

[ANNOUNCEMENT] Plan for dropping Python 2 support

2019-06-03 Thread Xiangrui Meng
Hi all, Today we announced the plan for dropping Python 2 support [1] in Apache Spark: As many of you already knew, Python core development team and many utilized Python packages like Pandas and NumPy will drop Python 2 suppor

Spark Thriftserver on yarn, sql submit take long time.

2019-06-03 Thread Jun Zhu
Hi , Running thrift server on yarn. It's fast when beeline client send query to thrift server, but it take a while(about 90s) to submit to yarn cluster. >From Thrift server log: > *19/06/04 05:48:27* DEBUG SparkSQLOperationManager: Created Operation for > explain select count(*) from perf_as_repor

Re: Spark Thriftserver on yarn, sql submit take long time.

2019-06-03 Thread Jun Zhu
case without explain, also take long time to submit 19/06/04 05:56:37 DEBUG SparkSQLOperationManager: Created Operation for > select count(*) from perf_as_reportads with > session=org.apache.hive.service.cli.session.HiveSessionImpl@1f30fc84, > runInBackground=true > 19/06/04 05:56:37 INFO SparkEx