Re: Apache Flink - Difference between operator and function

2017-12-31 Thread M Singh
Thanks Gordon for your explanation.   Mans On Wednesday, December 20, 2017 2:16 PM, Tzu-Li (Gordon) Tai wrote: #yiv6533607487 body{font-family:Helvetica, Arial;font-size:13px;}Hi Mans, What's the difference between an operator and a function ?  An operator in Flink needs to handle pr

Re: Apache Flink - Difference between operator and function

2017-12-20 Thread Tzu-Li (Gordon) Tai
Hi Mans, What's the difference between an operator and a function ?  An operator in Flink needs to handle processing of watermarks, records, and checkpointing of the operator state. To implement one, you need to extend the AbstractStreamOperator base class. It is considered a very low-level API

Apache Flink - Difference between operator and function

2017-12-20 Thread M Singh
Hi: I am reading the documentation on working with state (https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/stream/state/state.html) and it states that : All datastream functions can use managed state, but the raw state interfaces can only be used when implementing operators. Using