subject:"RDD to Dataframe Error"

Re: RDD to Dataframe Error

2016-11-28 Thread Mohit Jaggi

looks like you have RDD of JSON. Try this: http://spark.apache.org/docs/latest/sql-programming-guide.html#json-datasets Mohit Jaggi Founder, Data Orchard LLC www.dataorchardllc.com > On Nov 28, 2016, at 9:49 AM, J

Re: RDD to Dataframe Error

2016-11-28 Thread Jun Kim

Hi, Mark! Which kind of error message do you get? The simplest way to convert RDD to DF is just importing implicits and use toDF import spark.implicits._ val df = rdd.toDF :-) 2016년 11월 29일 (화) 오전 1:26, Mark Mikolajczak 님이 작성: > > > Hi All, > > Hoping you can help: > > > I have created an RDD

RDD to Dataframe Error

2016-11-28 Thread Mark Mikolajczak

Hi All, Hoping you can help: I have created an RDD from a NOSQL database and I want to convert the RDD to a data frame. I have tried many options but all result in errors. val df = sc.couchbaseQuery(test).map(_.value).collect().foreach(println) {"accountStatus":"AccountOpen","custId":"