Issue while submitting python beam pipeline on flink - local

hit a roadblock here. Please suggest. Please let me know if any other information is required. Ashish Raghav | DE Core Compete<https://corecompete.com/> | ashish.rag...@corecompete.com<mailto:adwait.th...@corecompete.com> Accelerating Cloud Analytics [cid:image001.jpg@01D6350F.2C3D1330][

RE: Issue while submitting python beam pipeline on flink - local

know the content is safe. Report suspicious email to info...@corecompete.com<mailto:info...@corecompete.com>. Hi Ashish, can you check to make sure apachebeam/flink1.9_job_server is also on version 2.21.0? On Thu, May 28, 2020 at 7:13 AM Ashish Raghav mailto:ashish.rag...@corecompe

RE: Issue while submitting python beam pipeline on flink - local

5f096d?context=explore On Thu, May 28, 2020 at 7:27 AM Ashish Raghav mailto:ashish.rag...@corecompete.com>> wrote: Hi Kyle, The Latest Version available on docker hub is 2.20.0 From: Kyle Weaver mailto:kcwea...@google.com>> Sent: 28 May 2020 16:51 To: user@beam.apache.org<mailto

RE: Issue while submitting python beam pipeline on flink - local

mages/sha256-eeac6dd4571794a8f985e9967fa0c1522aa56a28b5b0a0a34490a600065f096d?context=explore On Thu, May 28, 2020 at 7:27 AM Ashish Raghav mailto:ashish.rag...@corecompete.com>> wrote: Hi Kyle, The Latest Version available on docker hub is 2.20.0 From: Kyle Weaver mailto:kcwea...@google.com>> Se

Issue while submitting python beam pipeline on flink cluster - local

;--flink_master=192.168.99.100:8081", versions: Apache Beam SDK=2.21.0 python=3.7.6 Flink=1.9.3 Please suggest , if I am missing something. Ashish Raghav DEBUG:apache_beam.io.filesystem:translate_pattern: 'C:\\Users\\ashish.raghav\\Desktop\\projects\\test-flink\\input.txt&#x

RE: Issue while submitting python beam pipeline on flink - local

lt;_InactiveRpcError of RPC that terminated with: status = StatusCode.UNAVAILABLE details = "failed to connect to all addresses" debug_error_string = "{"created":"@1590667588.14600","description":"Failed to pick subch

RE: Issue while submitting python beam pipeline on flink cluster - local

I can set that up. Can I test on linux? Ashish Raghav | DE Core Compete | ashish.rag...@corecompete.com Accelerating Cloud Analytics -Original Message- From: Maximilian Michels Sent: 28 May 2020 17:34 To: user@beam.apache.org Subject: Re: Issue while submitting python beam pipeline on

RE: Issue while submitting python beam pipeline on flink - local

ggest using the default Docker environment. On 28.05.20 14:06, Ashish Raghav wrote: > Now it fails with this error: > > > > > > WARNING:root:Make sure that locally built Python SDK docker image has > Python 3.7 interpreter. > > INFO:root:Using Python SDK docker image:

RE: Issue while submitting python beam pipeline on flink - local

File "C:\Users\ashish.raghav\Desktop\projects\beam-venv\lib\site-packages\grpc\_utilities.py", line 86, in _block raise grpc.FutureTimeoutError() grpc.FutureTimeoutError -Original Message- From: Ashish Raghav Sent: 28 May 2020 18:22 To: user@beam.apache.org Subject: RE: Issue while submittin

Re: Issue while submitting python beam pipeline on flink - local

Hello Kyle, reply below. Also, what is the stack to run this as production setup on gcloud?? I can try that setup to see if this works. Get Outlook for Android From: Kyle Weaver Sent: Thursday, May 28, 2020, 10:34 PM To: user@beam.apache

Re: Issue while submitting python beam pipeline on flink cluster - local

cluster - local EXTERNAL EMAIL Do not click links or open attachments unless you recognise the sender and know the content is safe. Report suspicious email to info...@corecompete.com. Potentially a Windows issue. Do you have a Unix environment for testing? On 28.05.20 13:35, Ashish Raghav wrote

RE: Issue while submitting python beam pipeline on flink - local

this https://stackoverflow.com/questions/59429897/beam-running-on-flink-with-python-sdk-and-using-google-cloud-storage-for-artifac But it seems, there are other things to do to fix this. Please suggest. From: Ashish Raghav Sent: 30 May 2020 10:12 To: user@beam.apache.org Subject: Re: Issue

RE: Issue while submitting python beam pipeline on flink - local

unless you are running the Flink cluster on the same machine (we bind to `localhost` which prevents non-local connections). Please try the Docker-based execution, i.e. drop the `--environment_type=LOOPBACK` flag. On 31.05.20 20:25, Ashish Raghav wrote: > Hello Kyle, > > > > I did fi

RE: Issue while submitting python beam pipeline on flink - local

... 12 more Caused by: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.(UNIXProcess.java:247) at java.lang.ProcessImpl.start(ProcessImpl.java:134) at java.lang.ProcessBuilder.star

RE: Issue while submitting python beam pipeline on flink - local

gCache.getUnchecked(LocalCache.java:4964) ... 12 more Caused by: java.io.IOException: error=2, No such file or directory at java.lang.UNIXProcess.forkAndExec(Native Method) at java.lang.UNIXProcess.(UNIXProcess.java:247) at java.lang.ProcessImpl.start(ProcessImpl.ja