Re: Spark 1.3.1 - SQL Issues

2015-05-20 Thread ayan guha
Thanks a bunch On 21 May 2015 07:11, "Davies Liu" wrote: > The docs had been updated. > > You should convert the DataFrame to RDD by `df.rdd` > > On Mon, Apr 20, 2015 at 5:23 AM, ayan guha wrote: > > Hi > > Just upgraded to Spark 1.3.1. > > > > I am getting an warning > > > > Warning (from warni

Re: Spark 1.3.1 - SQL Issues

2015-05-20 Thread Davies Liu
The docs had been updated. You should convert the DataFrame to RDD by `df.rdd` On Mon, Apr 20, 2015 at 5:23 AM, ayan guha wrote: > Hi > Just upgraded to Spark 1.3.1. > > I am getting an warning > > Warning (from warnings module): > File > "D:\spark\spark-1.3.1-bin-hadoop2.6\spark-1.3.1-bin-had

Spark 1.3.1 - SQL Issues

2015-04-20 Thread ayan guha
Hi Just upgraded to Spark 1.3.1. I am getting an warning Warning (from warnings module): File "D:\spark\spark-1.3.1-bin-hadoop2.6\spark-1.3.1-bin-hadoop2.6\spark-1.3.1-bin-hadoop2.6\python\pyspark\sql\context.py", line 191 warnings.warn("inferSchema is deprecated, please use createDataFrame