Hi Francis Conroy, Do you want to debug the PyFlink job submitted via `flink run`? There is documentation [1] on how to debug it via `PyCharm`.
PS: It supports the loopback mode in PyFlink which is enabled in local deployment. That's when you execute the PyFlink jobs locally, e.g. when executing it directly in IDE. With the loopback mode, you could simply set a breakpoint in the source code in the IDE. More information could refer to [2]. [1] https://nightlies.apache.org/flink/flink-docs-release-1.14/docs/dev/python/debugging/#remote-debug [2] https://flink.apache.org/news/2021/09/29/release-1.14.0.html#loopback-mode-for-debugging On Tue, Oct 19, 2021 at 1:34 PM Francis Conroy <francis.con...@switchdin.com> wrote: > Hi, > > I'm trying to install some required modules by supplying a requirements > file when submitting to the cluster and the CLI just seems to stall. I've > built 1.15-SNAPSHOT@7578758fa8c84314b8b3206629b3afa9ff41b636 and have run > the wordcount example, everything else seems to work, I just can't submit a > pyflink job to my cluster when using the --pyRequirements option. > > I started going down the line of debugging the flink CLI using intellij > idea, but wasn't able to figure out how to make my venv with pyflink > installed available to the debug environment. > > Thanks, > Francis Conroy > > This email and any attachments are proprietary and confidential and are > intended solely for the use of the individual to whom it is addressed. Any > views or opinions expressed are solely those of the author and do not > necessarily reflect or represent those of SwitchDin Pty Ltd. If you have > received this email in error, please let us know immediately by reply email > and delete it from your system. You may not use, disseminate, distribute or > copy this message nor disclose its contents to anyone. > SwitchDin Pty Ltd (ABN 29 154893857) PO Box 1165, Newcastle NSW 2300 > Australia >
