dianfu commented on a change in pull request #10430: [FLINK-14019][python][cli]
Add command-line options for managing Python UDF environment and dependencies.
URL: https://github.com/apache/flink/pull/10430#discussion_r354669358
##########
File path:
flink-clients/src/main/java/org/apache/flink/client/cli/CliFrontendParser.java
##########
@@ -126,14 +126,44 @@
static final Option PYFILES_OPTION = new Option("pyfs", "pyFiles", true,
"Attach custom python files for job. " +
- "Comma can be used as the separator to specify multiple
files. " +
- "The standard python resource file suffixes such as
.py/.egg/.zip are all supported." +
- "(eg: --pyFiles
file:///tmp/myresource.zip,hdfs:///$namenode_address/myresource2.zip)");
+ "These files will be added to the PYTHONPATH of both
the local client and the remote python UDF worker. " +
+ "The standard python resource file suffixes such as
.py/.egg/.zip or directory are all supported. " +
+ "Comma (',') could be used as the separator to specify
multiple files " +
+ "(e.g.: --pyFiles
file:///tmp/myresource.zip,hdfs:///$namenode_address/myresource2.zip).");
static final Option PYMODULE_OPTION = new Option("pym", "pyModule",
true,
"Python module with the program entry point. " +
"This option must be used in conjunction with
`--pyFiles`.");
+ static final Option PYREQUIREMENTS_OPTION = new Option("pyreq",
"pyRequirements", true,
+ "Specify a requirements.txt file which defines the third-party
dependencies. " +
+ "These dependencies will be installed and added to the
PYTHONPATH of the python UDF worker. " +
+ "A directory which contains the installation packages
of these dependencies could be specified" +
+ "via second parameter. Use '#' as the separator of
parameters if second parameter exists. " +
Review comment:
What about "could be specified optionally. Use '#' as the separator if the
optional parameter exists. "?
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
With regards,
Apache Git Services
