[DISCUSS] Python (and Non-JVM) Language Support in Flink

2018-12-13 Thread Xianda Ke
Currently there is an ongoing survey about Python usage of Flink [1]. Some discussion was also brought up there regarding non-jvm language support strategy in general. To avoid polluting the survey thread, we are starting this discussion thread and would like to move the discussions here. In the i

Re: [SURVEY] Usage of flink-python and flink-streaming-python

2018-12-13 Thread Xianda Ke
t; On Tue, Dec 11, 2018 at 3:38 PM Thomas Weise wrote: > > > Did you take a look at Apache Beam? It already provides a comprehensive > > Python SDK and can be used with Flink: > > https://beam.apache.org/roadmap/portability/#python-on-flink > > > > We are using it

Re: [SURVEY] Usage of flink-python and flink-streaming-python

2018-12-11 Thread Xianda Ke
lish the design document then feel free to refer me to this > document. > > Cheers, > Till > > On Mon, Dec 10, 2018 at 3:08 AM Xianda Ke wrote: > > > Xianda Ke > > 9:47 AM (11 minutes ago) > > to dev, user > > After communicating with some of the inte

Re: [SURVEY] Usage of flink-python and flink-streaming-python

2018-12-09 Thread Xianda Ke
Xianda Ke 9:47 AM (11 minutes ago) to dev, user After communicating with some of the internal users at Alibaba, my impression is that: - Most of them need C extensions support, they want to integrated their algorithms with stream processing,but Jython is unacceptable for them. - For

Re: [SURVEY] Usage of flink-python and flink-streaming-python

2018-12-09 Thread Xianda Ke
After communicating with some of the internal users at Alibaba, my impression is that: * Most of them need C extentions support, they want to integrated their algorithms with stream processing,but Jython is unacceptable for them. * For some users, who are only familiar with SQL/Python, developin