slow checkpoints

Hi all , I am facing one issue , when i have high back pressure my checkpoints start failing . please let me know how to deal with this kind of situations . Thanks Yubraj Singh . [image: Mailtrack]

Re: slow checkpoints

Hi Currently, checkpoint may be faile in high back pressure scenario, because the barrier alignment can't be done in expected time, you should fix the back pressure problem first. There is a FLIP[1] that wants to fix this issue. [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-76%3A+Una

Re: slow checkpoints

@Congxian , back pressure is due to job failure , some times job can fail and we need to catch up . Thanks Yubraj Singh [image: Mailtrack] Sender notified by Mailtrack

How to unsubscribe the Apache projects and jira issues notification

Hi Following blogs want to unsubscribe kindly guide. I tried from google..still mails receiving Also should unubscribe.. j...@apache.org user@flink.apache.org d...@flink.apache.org d...@beam.apache.org u...@beamho.apache.org Thanks

Re: Initialization of broadcast state before processing main stream

Maxim, great thanks. We'll try buffering. С уважением, Василий Мельник On Thu, 14 Nov 2019 at 19:36, Maxim Parkachov wrote: > Hi Vasily, > > unfortunately, this is known issue with Flink, you could read discussion > under > https://cwiki.apache.org/confluence/display/FLINK/FLIP-17+Side+Inputs+

Broadcast checkpoint serialization fail

Hi all. In Flink 1.8 we have strange exception that causes job failing: 2019-11-14 15:52:52,071 INFO org.apache.flink.runtime.executiongraph.ExecutionGraph- op4 (1/1) (797d4c2b85010dab6be5e1d06ff6493a) switched from RUNNING to FAILED. AsynchronousException{java.lang.Exception: Could not m

Re: slow checkpoints

Hi Yubraj, So the frequent job failure is the root reason, you need to fix it. Yes, when too many messages are squashed into the message system. If the messages can not be consumed normally, there would exist catchup consuming which will cause your streaming system more pressure than usual. Best,

Re: How to unsubscribe the Apache projects and jira issues notification

Hi, Please check the first link on google "unsubscribe user@flink.apache.org” Piotrek > On 15 Nov 2019, at 11:40, P. Ramanjaneya Reddy wrote: > > Hi > > Following blogs want to unsubscribe kindly guide. > > I tried from google..still mails receiving > > Also should unubscribe.. > > j...@ap

unsubscribe

-- With thanks, Katherin Pudikova

Re: How to unsubscribe the Apache projects and jira issues notification

https://apache.org/foundation/mailinglists.html#request-addresses-for-unsubscribing If you want to subscribe to l...@apache.org then you need to send a message to list-subscr...@apache.org To get off a list, send a message to list-unsubscr...@apache.org On Fri, Nov 15, 2019 at 2:40 AM P. Raman

Keyed raw state - example

Hello everyone, I would like to know if anybody has a working example on how to declare a keyed raw state ( in my case a keyedprocessoperator) and how to use it in my UDF (keyedprocessfunction)? Basicaly we have a huge problem with a ValueState w Rocksdb, getting serialized for every element ( n

how to setup a ha flink cluster on k8s?

I'm trying to setup a flink cluster on k8s for production use.But the setup here https://ci.apache.org/projects/flink/flink-docs-release-1.9/ops/deployment/kubernetes.html  this not ha , when job-manager down and rescheduled the metadata for running job is lost.    I tried to use ha setup for