Hello Kyle, reply below. Also, what is the stack to run this as production setup on gcloud?? I can try that setup to see if this works.
Get Outlook for Android<https://aka.ms/ghei36> ________________________________ From: Kyle Weaver <kcwea...@google.com> Sent: Thursday, May 28, 2020, 10:34 PM To: user@beam.apache.org Subject: Re: Issue while submitting python beam pipeline on flink - local EXTERNAL EMAIL Do not click links or open attachments unless you recognise the sender and know the content is safe. Report suspicious email to info...@corecompete.com. > You are using the LOOPBACK environment which requires that the Flink > cluster can connect back to your local machine. Since the loopback > environment by defaults binds to localhost that should not be possible. On the Flink runner page, we recommend using --net=host to avoid the kinds of networking issues Ashish is experiencing. But the Docker documentation says the host networking option is only available on Linux (https://docs.docker.com/network/host/). You will either have to: a) expose the required ports, or ==> I tried exposing 8099 and not using --net=host on docker desktop for windows and it did not work. I also tried running job server on gcloud shell and submitting pipeline over gcloud shell after setting up all requirements. it fails with same errors as local. b) run the job server in a local process instead of a Docker container, as described in older versions of the documentation ==> I havent tried it yet. (https://web.archive.org/web/20191228110311/https://beam.apache.org/documentation/runners/flink/)
