Wow! This is bad! I am using reactive mode and this is indeed the issue. This should have been urgently patched as jobs with upgraded Flink version are in very precarious position. With all the other upgrades (rocksdb, etc.) going into 1.15.0 there's no easy rollback.
On Fri, Jul 1, 2022 at 8:14 AM Lijie Wang <wangdachui9...@gmail.com> wrote: > Hi, > Are you using the reactive mode? There is a known issue like that: > https://issues.apache.org/jira/browse/FLINK-28274 > > Best, > Lijie > > yuxia <luoyu...@alumni.sjtu.edu.cn> 于2022年7月1日周五 09:49写道： > >> I'm not sure why it happened. But from the Flink source code, it seems >> try to restore from an invalid state. Seems the state actually contains >> more that one value, but Flink expected the state should contains one or >> zero value. >> >> Best regards, >> Yuxia >> >> ------------------------------ >> *发件人: *"Vishal Surana" <vis...@moengage.com> >> *收件人: *"User" <user@flink.apache.org> >> *发送时间: *星期五, 2022年 7 月 01日 上午 5:28:07 >> *主题: *ContinuousFileMonitoringFunction retrieved invalid state. >> >> My job is unable to restore state after savepoint due to the following >> exception. Seems to be a rare exception as I haven't found any forum >> discussing it. Please advise. >> >> java.lang.IllegalArgumentException: ContinuousFileMonitoringFunction >> retrieved invalid state. >> at >> org.apache.flink.util.Preconditions.checkArgument(Preconditions.java:138) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.api.functions.source.ContinuousFileMonitoringFunction.initializeState(ContinuousFileMonitoringFunction.java:167) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.util.functions.StreamingFunctionUtils.tryRestoreFunction(StreamingFunctionUtils.java:189) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.util.functions.StreamingFunctionUtils.restoreFunctionState(StreamingFunctionUtils.java:171) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.initializeState(AbstractUdfStreamOperator.java:94) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.api.operators.StreamOperatorStateHandler.initializeOperatorState(StreamOperatorStateHandler.java:122) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.api.operators.AbstractStreamOperator.initializeState(AbstractStreamOperator.java:286) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.runtime.tasks.RegularOperatorChain.initializeStateAndOpenOperators(RegularOperatorChain.java:106) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.runtime.tasks.StreamTask.restoreGates(StreamTask.java:700) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.runtime.tasks.StreamTaskActionExecutor$SynchronizedStreamTaskActionExecutor.call(StreamTaskActionExecutor.java:100) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.runtime.tasks.StreamTask.restoreInternal(StreamTask.java:676) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.streaming.runtime.tasks.StreamTask.restore(StreamTask.java:643) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.runtime.taskmanager.Task.runWithSystemExitMonitoring(Task.java:948) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at >> org.apache.flink.runtime.taskmanager.Task.restoreAndInvoke(Task.java:917) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at org.apache.flink.runtime.taskmanager.Task.doRun(Task.java:741) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:563) >> ~[job-0.14-SNAPSHOT.jar:0.15-SNAPSHOT] >> at java.lang.Thread.run(Thread.java:829) ~[?:?] >> >> -- >> Regards, >> Vishal >> >> -- Regards, Vishal
