Re: Why OnDataStream in flink accepts partial function but DataStream do not

2019-01-31 Thread Dawid Wysakowicz
Hi, AFAIK it clashes with def map[R: TypeInformation](mapper: MapFunction[T, R]): DataStream[R] if you use partially applied function. You can check the discussion behind the OnDataStream implementation in this jira[1]. [1] https://issues.apache.org/jira/browse/FLINK-1159 On 31/01/2019 04:10,

Why OnDataStream in flink accepts partial function but DataStream do not

2019-01-30 Thread Renkai
As shown in https://ci.apache.org/projects/flink/flink-docs-master/dev/scala_api_extensions.html ,we can use scala partitial function by import org.apache.flink.streaming.api.scala.extensions._ and replace .map by .mapWith. but the signature of def mapWith[R: TypeInformation](fun: T => R): DataSt