Re: trouble using Aggregator with DataFrame

2016-02-17 Thread Koert Kuipers
https://issues.apache.org/jira/browse/SPARK-13363 On Wed, Feb 17, 2016 at 3:02 PM, Michael Armbrust wrote: > Glad you like it :) > > This sounds like a bug, and we should fix it as we merge DataFrame / > Dataset for 2.0. Could you open JIRA targeted at 2.0? > > On Wed, Feb 17, 2016 at 2:22 PM,

Re: trouble using Aggregator with DataFrame

2016-02-17 Thread Michael Armbrust
Glad you like it :) This sounds like a bug, and we should fix it as we merge DataFrame / Dataset for 2.0. Could you open JIRA targeted at 2.0? On Wed, Feb 17, 2016 at 2:22 PM, Koert Kuipers wrote: > first of all i wanted to say that i am very happy to see > org.apache.spark.sql.expressions.Agg

trouble using Aggregator with DataFrame

2016-02-17 Thread Koert Kuipers
first of all i wanted to say that i am very happy to see org.apache.spark.sql.expressions.Aggregator, it is a neat api, especially when compared to the UDAF/AggregateFunction stuff. its doc/comments says: A base class for user-defined aggregations, which can be used in [[DataFrame]] and [[Dataset]