The installation happens in a separate process and so there should be no
direct relationship between them. Could you try to take a look at whether
the GC runs normally. Besides, you could also try to increase the heartbeat
timeout.
Regards,
Dian
On Fri, Dec 24, 2021 at 12:02 PM Paul Lam wrote:
Hi Dian,
Thanks lot for your pointer!
I tried `-pyreq` and it worked as expected in general. But another problem
arises when I tried to specified more dependencies in the requirements.txt.
The taskmanagers are often lost(unreachable from jobmanager) during the process
of pip install.
I wond
Hi Paul,
Currently, you need to build venv in an environment where you want to
execute the PyFlink jobs.
>> Also, I wonder if it’s possible for pyflink to optionally provide an
automatically created venv for each pyflink job?
Do you mean to create the venv during executing the job? If this is you
Hi,
The document says we could use `-pyarch` to upload python venv, but I found
this is often problematic because users may not have the python binaries that
fits the flink runtime environment.
For example, a user may upload a venv for macOS within the project, but the
Flink cluster is using
