Re: ***UNCHECKED*** Re: Checkpointing not working

2018-09-19 Thread Vijay Bhaskar
Can you please check the following document and verify whether you have enough network bandwidth to support 30 seconds check point interval worth of the streaming data? https://data-artisans.com/blog/how-to-size-your-apache-flink-cluster-general-guidelines Regards Bhaskar On Wed, Sep 19, 2018 at

***UNCHECKED*** Re: Checkpointing not working

2018-09-18 Thread yuvraj singh
log :: Checkpoint 58 of job 0efaa0e6db5c38bec81dfefb159402c0 expired before completing. I have a use case where i need to do the checkpointing frequently . i am using Kafka to read stream and making a window of 1 hour , which is having 50gb data always and it can be more than that . i have seen