_DIRTY.json 看下以这个结尾的文件,内容应该是一个 json,如果不是标准 json 说明数据已经异常了,可以尝试删除
Best, Weihua On Tue, Mar 14, 2023 at 11:23 AM Jason_H <[email protected]> wrote: > 您好, > 我找到了我的ha目录,请教一下,怎么确定哪些数据是脏数据,可以允许删除的,这个有什么办法可以确定吗,我看到的都是些系统数据 > > > | | > Jason_H > | > | > [email protected] > | > ---- 回复的原邮件 ---- > | 发件人 | Weihua Hu<[email protected]> | > | 发送日期 | 2023年3月14日 10:39 | > | 收件人 | <[email protected]> | > | 主题 | Re: flink k8s 部署启动报错 | > Hi, > > 看异常信息是 Flink 集群在启动时检索到 HA 路径上存在 DirtyResults 数据,但是数据已经不完整了,无法正常读取。 > 可以参考文档[1],检查相关的 HA 路径,清理下异常数据 > > 另外问一下,之前是通过同名的 cluster-id 启动过 Flink 集群吗? > > [1] > > https://nightlies.apache.org/flink/flink-docs-master/docs/deployment/config/#job-result-store-storage-path > > Best, > Weihua > > > On Tue, Mar 14, 2023 at 9:58 AM Jason_H <[email protected]> wrote: > > hi,大家好 > 请教一个问题,我在k8s上部署的flink集群,启动不来,报如下的错误,大家有遇到过吗 > java.util.concurrent.CompletionException: > org.apache.flink.util.FlinkRuntimeException: Could not retrieve JobResults > of globally-terminated jobs from JobResultStore > at java.util.concurrent.CompletableFuture.encodeThrowable(Unknown > Source) ~[?:?] > at > java.util.concurrent.CompletableFuture.completeThrowable(Unknown Source) > [?:?] > at java.util.concurrent.CompletableFuture$AsyncSupply.run(Unknown > Source) [?:?] > at java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown > Source) [?:?] > at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown > Source) [?:?] > at java.lang.Thread.run(Unknown Source) [?:?] > Caused by: org.apache.flink.util.FlinkRuntimeException: Could not retrieve > JobResults of globally-terminated jobs from JobResultStore > at > > org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess.getDirtyJobResults(SessionDispatcherLeaderProcess.java:192) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess.supplyUnsynchronizedIfRunning(AbstractDispatcherLeaderProcess.java:198) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess.getDirtyJobResultsIfRunning(SessionDispatcherLeaderProcess.java:184) > ~[flink-dist-1.15.2.jar:1.15.2] > ... 4 more > Caused by: > > org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.exc.MismatchedInputException: > No content to map due to end-of-input > at [Source: (org.apache.flink.runtime.fs.hdfs.HadoopDataInputStream); > line: 1, column: 0] > at > > org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4688) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4586) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.shaded.jackson2.com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3585) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.runtime.highavailability.FileSystemJobResultStore.getDirtyResultsInternal(FileSystemJobResultStore.java:190) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.runtime.highavailability.AbstractThreadsafeJobResultStore.withReadLock(AbstractThreadsafeJobResultStore.java:118) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.runtime.highavailability.AbstractThreadsafeJobResultStore.getDirtyResults(AbstractThreadsafeJobResultStore.java:100) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess.getDirtyJobResults(SessionDispatcherLeaderProcess.java:190) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.runtime.dispatcher.runner.AbstractDispatcherLeaderProcess.supplyUnsynchronizedIfRunning(AbstractDispatcherLeaderProcess.java:198) > ~[flink-dist-1.15.2.jar:1.15.2] > at > > org.apache.flink.runtime.dispatcher.runner.SessionDispatcherLeaderProcess.getDirtyJobResultsIfRunning(SessionDispatcherLeaderProcess.java:184) > ~[flink-dist-1.15.2.jar:1.15.2] > ... 4 more > > > | | > Jason_H > | > | > [email protected] > | >
