Re: Window function in Spark SQL

2015-12-11 Thread Michael Armbrust
eate HIveContext Hive Server > should be running ? > > Regards, > Sourav > > > -- Forwarded message -- > From: > Date: Fri, Dec 11, 2015 at 11:39 AM > Subject: Re: Window function in Spark SQL > To: sourav.mazumde...@gmail.com > > > I

Fwd: Window function in Spark SQL

2015-12-11 Thread Sourav Mazumder
1.5.x that to create HIveContext Hive Server should be running ? Regards, Sourav -- Forwarded message -- From: Date: Fri, Dec 11, 2015 at 11:39 AM Subject: Re: Window function in Spark SQL To: sourav.mazumde...@gmail.com I’m not familiar with that issue, I wasn’t able to repro

Re: Window function in Spark SQL

2015-12-11 Thread Ross.Cramblit
Hey Sourav, Window functions require using a HiveContext rather than the default SQLContext. See here: http://spark.apache.org/docs/latest/sql-programming-guide.html#starting-point-sqlcontext HiveContext provides all the same functionality of SQLContext, as well as extra features like Window fu

Window function in Spark SQL

2015-12-11 Thread Sourav Mazumder
Hi, Spark SQL documentation says that it complies with Hive 1.2.1 APIs and supports Window functions. I'm using Spark 1.5.0. However, when I try to execute something like below I get an error val lol5 = sqlContext.sql("select ky, lead(ky, 5, 0) over (order by ky rows 5 following) from lolt") ja