When submitting PyFink jobs via Application Mode:
./bin/flink run-application -t yarn-application \
-Djobmanager.memory.process.size=1024m \
-Dtaskmanager.memory.process.size=1024m \
-Dyarn.application.name=test_applicationmode \
-pyclientexec /usr/bin/python \
-pyexec /usr/bin/python \
-python.pythonpath /usr/bin/python \
-py /data/module/flink-1.18.1/work_space/scripts/test.py
We encounter ModuleNotFoundError:pyflink despite all worker nodes having the
required Python packages. However, these jobs work properly in YARN Per-Job
mode. Could you give me some advise.
We would appreciate any code samples or configuration references you could
provide. Please find attached our full submission script and error logs for
reference.
Best regards,
Shiquan Song.
