Re: Pyflink 1.10.0 issue on cluster

Hi, You can use the `set_python_requirements` method to specify your requirement.txt which you can refer to the documentation[1] for details [1] https://ci.apache.org/projects/flink/flink-docs-release-1.11/dev/table/python/dependency_management.html#python-dependency Best, Xingbo rookieCOder 于2

Re: Pyflink 1.10.0 issue on cluster

Hi, And I've got another question. If I use user-defined function in pyflink, which only depends library A. And what the flink does is using the udf in tables. Does that mean I only need to install library A on the slaves? -- Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.na

Re: Pyflink 1.10.0 issue on cluster

Yes. You are right. Best, Xingbo rookieCOder 于2020年7月27日周一 下午6:30写道： > Hi, Xingbo > Thanks for your reply. > So the point is that simply link the source or the sink to the master's > local file system will cause the error that the slaves cannot read the > source/sink files? Thus the simplest so

Re: Pyflink 1.10.0 issue on cluster

Hi, Xingbo Thanks for your reply. So the point is that simply link the source or the sink to the master's local file system will cause the error that the slaves cannot read the source/sink files? Thus the simplest solution is to make sure that slaves have access to the master's local filesystem (by

Re: Pyflink 1.10.0 issue on cluster

Hi rookieCOder, You need to make sure that your files can be read by each slaves, so an alternative solution is to put your files on hdfs Best, Xingbo rookieCOder 于2020年7月27日周一 下午5:49写道： > 'm coding with pyflink 1.10.0 and building cluster with flink 1.10.0 > I define the source and the sink as

Pyflink 1.10.0 issue on cluster

'm coding with pyflink 1.10.0 and building cluster with flink 1.10.0 I define the source and the sink as following: When I run this code only on master, it's OK. When I run this code o