Re: Converting DataFrame to RDD of case class

2015-07-27 Thread Jonathan Winandy
Hello ! Can both methods be compare in term of performance ? Tried the pull request and it felt slow compare to manual mapping. Cheers, Jonathan On Mon, Jul 27, 2015, 8:51 PM Reynold Xin wrote: > There is this pull request: https://github.com/apache/spark/pull/5713 > > We mean to merge it for

Re: Converting DataFrame to RDD of case class

2015-07-27 Thread Reynold Xin
There is this pull request: https://github.com/apache/spark/pull/5713 We mean to merge it for 1.5. Maybe you can help review it too? On Mon, Jul 27, 2015 at 11:23 AM, Vyacheslav Baranov < slavik.bara...@gmail.com> wrote: > Hi all, > > For now it's possible to convert RDD of case class to DataFr

Converting DataFrame to RDD of case class

2015-07-27 Thread Vyacheslav Baranov
Hi all, For now it's possible to convert RDD of case class to DataFrame: case class Person(name: String, age: Int) val people: RDD[Person] = ... val df = sqlContext.createDataFrame(people) but backward conversion is not possible with existing API, so currently code looks like this (example fr