Thanks for the detailed info Xingbo, I am pretty new to the PyFlink module
so was mainly trying to experiment a little :)
I think supporting it in Flink 1.16 is more than enough, it would probably
be an overkill to try to backport this. The M1 issue only really occurs in
local development/testing.
Hi Gyula,
According to the log, we can see that you downloaded the source package of
pemja, not the wheel package of pemja[1]. I guess you are using the m1
machine. If you install pemja from the source package, you need to have
JDK, gcc tools and CPython with Numpy in the environment. I believe th
Here it is, copied from the docs essentially:
FROM flink:1.15.0
# install python3: it has updated Python to 3.9 in Debian 11 and so install
Python 3.7 from source
# it currently only supports Python 3.6, 3.7 and 3.8 in PyFlink officially.
RUN apt-get update -y && \
apt-get install -y build-esse
Hi Gyula,
I can build pyFlink image successfully by following this guide. Did you add
a dependency outside of the documentation? And could you provide your
Dockerfile
https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/resource-providers/standalone/docker/#using-flink-pytho
Well in any case either the official image is incorrect (maybe we should
include JDK by default not JRE) or we should update the
documentation regarding the python docker build because it simply doesn't
work at the moment.
I am still looking for a full working example that adds the required Python
In addition, you can try providing the Dockerfile
Best,
Weihua
On Tue, Jul 5, 2022 at 11:24 PM Weihua Hu wrote:
> Hi,
>
> The base image flink:1.15.0 is built from openjdk:11-jre, and this image
> only installs jre but not jdk.
> It looks like the package you want to install (pemja) depends on
Hi,
The base image flink:1.15.0 is built from openjdk:11-jre, and this image
only installs jre but not jdk.
It looks like the package you want to install (pemja) depends on jdk. you
need install openjdk-11-jdk in dockerfile,
take a look to how it is installed in the official image:
https://hub.do
Hi All!
I have been trying to experiment with the Flink python support on
Kubernetes but I got stuck creating a custom image with all the necessary
python libraries.
I found this guide in the docs:
https://nightlies.apache.org/flink/flink-docs-release-1.15/docs/deployment/resource-providers/stand
