Re: InferredSchema Example in Spark-SQL

2015-05-18 Thread Rajdeep Dua
rote: >>> >>>> Typo? Should be .toDF(), not .toRD() >>>> >>>> >>>> >>>> *From:* Ram Sriharsha [mailto:sriharsha@gmail.com] >>>> *Sent:* Monday, May 18, 2015 8:31 AM >>>> *To:* Rajdeep Dua >>>> *Cc:* use

Re: InferredSchema Example in Spark-SQL

2015-05-17 Thread Simon Elliston Ball
You mean toDF() not toRD(). It stands for data frame of that makes it easier to remember. Simon > On 18 May 2015, at 01:07, Rajdeep Dua wrote: > > Hi All, > Was trying the Inferred Schema spart example > http://spark.apache.org/docs/latest/sql-programming-guide.html#overview > > I am getting

Re: InferredSchema Example in Spark-SQL

2015-05-17 Thread Ram Sriharsha
Int)).toDF() >> >> >> On Sun, May 17, 2015 at 5:41 PM, Cheng, Hao wrote: >> >>> Typo? Should be .toDF(), not .toRD() >>> >>> >>> >>> *From:* Ram Sriharsha [mailto:sriharsha@gmail.com] >>> *Sent:* Monday, May

Re: InferredSchema Example in Spark-SQL

2015-05-17 Thread Rajdeep Dua
lto:sriharsha@gmail.com] >> *Sent:* Monday, May 18, 2015 8:31 AM >> *To:* Rajdeep Dua >> *Cc:* user >> *Subject:* Re: InferredSchema Example in Spark-SQL >> >> >> >> you mean toDF() ? (toDF converts the RDD to a DataFrame, in this case >> inferr

Re: InferredSchema Example in Spark-SQL

2015-05-17 Thread Rajdeep Dua
8, 2015 8:31 AM > *To:* Rajdeep Dua > *Cc:* user > *Subject:* Re: InferredSchema Example in Spark-SQL > > > > you mean toDF() ? (toDF converts the RDD to a DataFrame, in this case > inferring schema from the case class) > > > > > > > > On Sun, May 1

RE: InferredSchema Example in Spark-SQL

2015-05-17 Thread Cheng, Hao
Typo? Should be .toDF(), not .toRD() From: Ram Sriharsha [mailto:sriharsha@gmail.com] Sent: Monday, May 18, 2015 8:31 AM To: Rajdeep Dua Cc: user Subject: Re: InferredSchema Example in Spark-SQL you mean toDF() ? (toDF converts the RDD to a DataFrame, in this case inferring schema from the

RE: InferredSchema Example in Spark-SQL

2015-05-17 Thread Cheng, Hao
Forgot to import the implicit functions/classes? import sqlContext.implicits._ From: Rajdeep Dua [mailto:rajdeep@gmail.com] Sent: Monday, May 18, 2015 8:08 AM To: user@spark.apache.org Subject: InferredSchema Example in Spark-SQL Hi All, Was trying the Inferred Schema spart example http

Re: InferredSchema Example in Spark-SQL

2015-05-17 Thread Ram Sriharsha
you mean toDF() ? (toDF converts the RDD to a DataFrame, in this case inferring schema from the case class) On Sun, May 17, 2015 at 5:07 PM, Rajdeep Dua wrote: > Hi All, > Was trying the Inferred Schema spart example > http://spark.apache.org/docs/latest/sql-programming-guide.html#overview > >

InferredSchema Example in Spark-SQL

2015-05-17 Thread Rajdeep Dua
Hi All, Was trying the Inferred Schema spart example http://spark.apache.org/docs/latest/sql-programming-guide.html#overview I am getting the following compilation error on the function toRD() value toRD is not a member of org.apache.spark.rdd.RDD[Person] [error] val people = sc.textFile("/ho