Re: Spark-sql can replace Hive ?

2021-06-15 Thread Mich Talebzadeh
OK you mean use spark.sql as opposed to HiveContext.sql? val HiveContext = new org.apache.spark.sql.hive.HiveContext(sc) HiveContext.sql("") replace with spark.sql("") ? view my Linkedin profile *Disclaimer:* Use it at yo

Re: Spark-sql can replace Hive ?

2021-06-15 Thread Battula, Brahma Reddy
Currently I am using hive sql engine for adhoc queries. As spark-sql also supports this, I want migrate from hive. From: Mich Talebzadeh Date: Thursday, 10 June 2021 at 8:12 PM To: Battula, Brahma Reddy Cc: ayan guha , dev@spark.apache.org , u...@spark.apache.org Subject: Re: Spark-sql can

Re: Apache Spark 3.2 Expectation

2021-06-15 Thread Hyukjin Kwon
+1, thanks. On Tue, 15 Jun 2021, 16:17 Gengliang Wang, wrote: > Hi, > > As the expected release date is close, I would like to volunteer as the > release manager for Apache Spark 3.2.0. > > Thanks, > Gengliang > > On Mon, Apr 12, 2021 at 1:59 PM Wenchen Fan wrote: > >> An update: we found a mi

Re: Apache Spark 3.2 Expectation

2021-06-15 Thread Gengliang Wang
Hi, As the expected release date is close, I would like to volunteer as the release manager for Apache Spark 3.2.0. Thanks, Gengliang On Mon, Apr 12, 2021 at 1:59 PM Wenchen Fan wrote: > An update: we found a mistake that we picked the Spark 3.2 release date > based on the scheduled release d