Re: Spark-sql can replace Hive ?

These are different things. Spark provides a computational layer and a dialogue of SQL based on Hive. Hive is a DW on top of HDFS. What are you trying to replace? HTH view my Linkedin profile *Disclaimer:* Use it at your own risk

Re: Spark-sql can replace Hive ?

Thanks for prompt reply. I want to replace hive with spark. From: ayan guha Date: Thursday, 10 June 2021 at 4:35 PM To: Battula, Brahma Reddy Cc: d...@spark.apache.org , user@spark.apache.org Subject: Re: Spark-sql can replace Hive ? Would you mind expanding the ask? Spark Sql can use hive

Re: Spark-sql can replace Hive ?

Would you mind expanding the ask? Spark Sql can use hive by itaelf On Thu, 10 Jun 2021 at 8:58 pm, Battula, Brahma Reddy wrote: > Hi > > > > Would like know any refences/docs to replace hive with spark-sql > completely like how migrate the existing data in hive.? > > > > thanks > > > > > -- Bes

Spark-sql can replace Hive ?

Hi Would like know any refences/docs to replace hive with spark-sql completely like how migrate the existing data in hive.? thanks

Apply window function on data consumed from Kafka topic

Hi, I have a requirement to create a spark streaming job that get data from kafka broker and need to apply window function on the data coming into the spark context. This is how I connected to kafka from spark val kafkaParams = Map[String, Object]( "bootstrap.servers" -> "",