Re: Flink Python streaming

2018-10-08 Thread Chesnay Schepler
Hello, to use libraries you have to supply them when submitting the job as described below. Additional directories/files will be placed in the same directory as your script on each TM. See https://ci.apache.org/projects/flink/flink-docs-master/dev/stream/python.html#executing-plans Note th

Re: Flink Python streaming

2018-10-03 Thread Fabian Hueske
Hi, AFAIK it's not that easy. Flink's Python support is based on Jython which translates Python code into JVM byte code. Therefore, native libs are not supported. Chesnay (in CC) knows the details here. Best, Fabian Hequn Cheng schrieb am Mi., 3. Okt. 2018, 04:30: > Hi Bing, > > I'm not famil

Re: Flink Python streaming

2018-10-02 Thread Hequn Cheng
Hi Bing, I'm not familiar with python programming. I guess we can simply import libraries in the python script. A example can be found here[1]. Hope this helps. Best, Hequn [1] https://github.com/wdm0006/flink-python-examples/blob/master/mandelbrot/mandelbrot_set.py On Wed, Oct 3, 2018 at 1:49 A

Flink Python streaming

2018-10-02 Thread Bing Lin
Hi, I'm wondering how I can add dependencies for third party and custom libraries to be executed in Flink for python streaming? Thank you, Bing