Re: Native iterations in PyFlink

2016-03-24 Thread Chesnay Schepler
Hello Shannon, you've picked yourself quite a feature there. The following classes will be relevant: * Python o DataSet o OperationInfo o Environment (_send_operation method) o Constants._Identifier * Java o PythonPlanBinder o PythonOperationInfo An (Python)Ope

Native iterations in PyFlink

2016-03-24 Thread Shannon Quinn
Hi all, I'm looking at Flink for highly iterative ALS-like distributed computations, and the concept of native iteration support was very attractive. However, I notice that the Python API is missing this item. I'd absolutely be interested in adding that component if someone could point me in