Re: checkpoint failure suddenly even state size is into 10 mb around

2019-09-02 Thread Biao Liu
Hi Sushant, Your screenshot shows the checkpoint expired. It means checkpoint did not finish in time. I guess the reason is the heavy back pressure blocks both data and barrier. But I can't tell why there was a heavy back pressure. If this scenario happens again, you could pay more attention to t

checkpoint failure suddenly even state size is into 10 mb around

2019-08-23 Thread Sushant Sawant
Hi all, m facing two issues which I believe are co-related though. 1. Kafka source shows high back pressure. 2. Sudden checkpoint failure for entire day until restart. My job does following thing, a. Read from Kafka b. Asyncio to external system c. Dumping in Cassandra, Elasticsearch Checkpointin