Hi all, DongLin, ZhiPeng and I are opening this thread to propose designing and implementing a new iteration library inside the Flink-ML project, as described in FLIP-176[1].
Iteration serves as a fundamental functionality required to support the implementation of ML algorithms. Previously Flink supports bounded iteration on top of the DataSet API and unbounded iteration on top of the DataStream API. However, since we are going to deprecated the dataset API and the current unbounded iteration API on top of the DataStream API is not fully complete, thus we are proposing to add the new unified iteration library on top of DataStream API to support both unbounded and bounded iterations. Very thanks for your feedbacks! [1] https://cwiki.apache.org/confluence/x/hAEBCw Best,Yun
