Re: Feature request: Java-specific transform method in Dataset

I am not affiliated with Flink or Spark but I do think some of the thoughts here makes sense On Sun, Jul 1, 2018 at 4:12 PM, Sean Owen wrote: > It's true, that is

Re: Feature request: Java-specific transform method in Dataset

It's true, that is one of the issues to be solved by the 2.12-compatible build, because it otherwise introduces an overload ambiguity for Java 8 lambdas. But for that reason I think the current transform() method would start working with lambdas. That would only help 2.12 builds; maybe that's an OK

Re: Feature request: Java-specific transform method in Dataset

This wouldn’t be a problem with Scala 2.12 right? On Sun, Jul 1, 2018 at 12:23 PM Sean Owen wrote: > I see, transform() doesn't have the same overload that other methods do in > order to support Java 8 lambdas as you'd expect. One option is to introduce > something like MapFunction for transform

Re: Feature request: Java-specific transform method in Dataset

I see, transform() doesn't have the same overload that other methods do in order to support Java 8 lambdas as you'd expect. One option is to introduce something like MapFunction for transform and introduce an overload. I think transform() isn't used much at all, so maybe why it wasn't Java-fied. B

Re: Feature request: Java-specific transform method in Dataset

No, because Function1 from Scala is not a functional interface. You can see a simple example of what I'm trying to accomplish In the unit test here: https://github.com/void/spark/blob/java-transform/sql/core/src/test/java/test/org/apache/spark/sql/JavaDataFrameSuite.java#L73 On Sun, Jul 1, 2018 a

Re: Feature request: Java-specific transform method in Dataset

Don't Java 8 lambdas let you do this pretty immediately? Can you give an example here of what you want to do and how you are trying to do it? On Sun, Jul 1, 2018, 12:42 PM Ismael Carnales wrote: > Hi, > it would be nice to have an easier way to use the Dataset transform > method from Java than

Feature request: Java-specific transform method in Dataset

Hi, it would be nice to have an easier way to use the Dataset transform method from Java than implementing a Function1 from Scala. I've made a simple implentation here: https://github.com/void/spark/tree/java-transform Should I open a JIRA? Ismael Carnales