On Wed, Feb 3, 2016 at 1:42 PM, Nirav Patel <npa...@xactlycorp.com> wrote:
> Awesome! I just read design docs. That is EXACTLY what I was talking > about! Looking forward to it! > Great :) Most of the API is there in 1.6. For the next release I would like to unify DataFrame <-> Dataset and do a lot of work on performance. Fair warning, 1.6 there are cases where Datasets are slower than RDDs, but we are putting a lot off effort into improving that.