This wouldn’t be a problem with Scala 2.12 right? On Sun, Jul 1, 2018 at 12:23 PM Sean Owen <sro...@gmail.com> wrote:
> I see, transform() doesn't have the same overload that other methods do in > order to support Java 8 lambdas as you'd expect. One option is to introduce > something like MapFunction for transform and introduce an overload. > > I think transform() isn't used much at all, so maybe why it wasn't > Java-fied. Before Java 8 it wouldn't have made much sense in Java. Now it > might. I think it could be OK to add the overload to match how map works. > > On Sun, Jul 1, 2018 at 1:33 PM Ismael Carnales <icarna...@gmail.com> > wrote: > >> No, because Function1 from Scala is not a functional interface. >> You can see a simple example of what I'm trying to accomplish In the unit >> test here: >> >> https://github.com/void/spark/blob/java-transform/sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java#L73 >> >> >> On Sun, Jul 1, 2018 at 2:48 PM Sean Owen <sro...@gmail.com> wrote: >> >>> Don't Java 8 lambdas let you do this pretty immediately? Can you give an >>> example here of what you want to do and how you are trying to do it? >>> >>> On Sun, Jul 1, 2018, 12:42 PM Ismael Carnales <icarna...@gmail.com> >>> wrote: >>> >>>> Hi, >>>> it would be nice to have an easier way to use the Dataset transform >>>> method from Java than implementing a Function1 from Scala. >>>> >>>> I've made a simple implentation here: >>>> >>>> https://github.com/void/spark/tree/java-transform >>>> >>>> Should I open a JIRA? >>>> >>>> Ismael Carnales >>>> >>>
