Re: FW: Constant backpressure on flink job

2019-05-20 Thread Till Rohrmann
gt; > > Regards, > > Georgi Stoyanov > > > > *From:* Monika Hristova > *Sent:* Tuesday, May 7, 2019 3:55 PM > *To:* Dawid Wysakowicz ; user@flink.apache.org > *Subject:* RE: Constant backpressure on flink job > > > > Hello Dawid, > > > > Thank yo

Re: FW: Constant backpressure on flink job

2019-05-20 Thread Dawid Wysakowicz
on? > >   > > Regards, > > Georgi Stoyanov > >   > > *From:*Monika Hristova > *Sent:* Tuesday, May 7, 2019 3:55 PM > *To:* Dawid Wysakowicz ; user@flink.apache.org > *Subject:* RE: Constant backpressure on flink job > >   > > Hello Dawid, > &g

Re: Constant backpressure on flink job

2019-04-25 Thread Dawid Wysakowicz
Hi Monika, I would start with identifying the operator that causes backpressure. More information how to monitor backpressure you can find here in the docs[1]. You might also be interested in Seth's (cc'ed) webinar[2], where he also talks how to debug backpressure. Best, Dawid [1] https://ci.ap

Constant backpressure on flink job

2019-04-22 Thread Monika Hristova
Hello, We are experiencing regular backpressure (at least once a week). I would like to ask how we can fix it. Currently our configurations are: vi /usr/lib/flink/conf/flink-conf.yaml # Settings applied by Cloud Dataproc initialization action jobmanager.rpc.address: bonusengine-prod-m-0 jobmanag