?????? need help about "incremental checkpoint",Thanks

[??????]

Thanks for your replies~!


My English is poor ,I have an understanding of your replies:


Write in RocksDbStateBackend.
Read in FsStateBackend.
It's NOT a match.
So I'm wrong in step 5?
Is my above understanding right?


Thanks for your help.


------------------ ???????? ------------------
??????:                                                                         
                                               "David Anderson"                 
                                                                   
<dander...@apache.org&gt;;
????????:&nbsp;2020??10??2??(??????) ????10:35
??????:&nbsp;"??????"<appleyu...@foxmail.com&gt;;
????:&nbsp;"user"<user@flink.apache.org&gt;;
????:&nbsp;Re: need help about "incremental checkpoint",Thanks



It looks like you were trying&nbsp;to resume from a checkpoint taken with the 
FsStateBackend into a revised version of the job that uses the 
RocksDbStateBackend. Switching state backends in this way is not supported: 
checkpoints and savepoints are written in a state-backend-specific format, and 
can only be read by the same backend that wrote them.

It is possible, however, to migrate between state backends using the State 
Processor API [1].


[1]&nbsp;https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html


Best,
David


On Fri, Oct 2, 2020 at 4:07 PM ?????? <appleyu...@foxmail.com&gt; wrote:


I want to do an experiment of"incremental checkpoint"
 
my code is:
 
https://paste.ubuntu.com/p/DpTyQKq6Vk/
 
&nbsp;
 
pom.xml is:
 
<?xml version="1.0" encoding="UTF-8"?&gt;
 <project xmlns="http://maven.apache.org/POM/4.0.0";
 xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance";
 xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 
http://maven.apache.org/xsd/maven-4.0.0.xsd"&gt;
 <modelVersion&gt;4.0.0</modelVersion&gt;
 
<groupId&gt;example</groupId&gt;
 <artifactId&gt;datastream_api</artifactId&gt;
 <version&gt;1.0-SNAPSHOT</version&gt;
 <build&gt;
 <plugins&gt;
 <plugin&gt;
 <groupId&gt;org.apache.maven.plugins</groupId&gt;
 <artifactId&gt;maven-compiler-plugin</artifactId&gt;
 <version&gt;3.1</version&gt;
 <configuration&gt;
 <source&gt;1.8</source&gt;
 <target&gt;1.8</target&gt;
 </configuration&gt;
 </plugin&gt;
 
<plugin&gt;
 <groupId&gt;org.scala-tools</groupId&gt;
 <artifactId&gt;maven-scala-plugin</artifactId&gt;
 <version&gt;2.15.2</version&gt;
 <executions&gt;
 <execution&gt;
 <goals&gt;
 <goal&gt;compile</goal&gt;
 <goal&gt;testCompile</goal&gt;
 </goals&gt;
 </execution&gt;
 </executions&gt;
 </plugin&gt;
 
&nbsp;
 
</plugins&gt;
 </build&gt;
 
<dependencies&gt;
 
<!-- https://mvnrepository.com/artifact/org.apache.flink/flink-streaming-scala 
--&gt;
 <dependency&gt;
 <groupId&gt;org.apache.flink</groupId&gt;
 <artifactId&gt;flink-streaming-scala_2.11</artifactId&gt;
 <version&gt;1.11.1</version&gt;
 <!-<scope&gt;provided</scope&gt;-&gt;
 </dependency&gt;
 
<!-<dependency&gt;-&gt;
 <!-<groupId&gt;org.apache.flink</groupId&gt;-&gt;
 <!-<artifactId&gt;flink-streaming-java_2.12</artifactId&gt;-&gt;
 <!-<version&gt;1.11.1</version&gt;-&gt;
 <!-<!?C<scope&gt;compile</scope&gt;?C&gt;-&gt;
 <!-</dependency&gt;-&gt;
 
<dependency&gt;
 <groupId&gt;org.apache.flink</groupId&gt;
 <artifactId&gt;flink-clients_2.11</artifactId&gt;
 <version&gt;1.11.1</version&gt;
 </dependency&gt;
 
&nbsp;
 
<dependency&gt;
 <groupId&gt;org.apache.flink</groupId&gt;
 <artifactId&gt;flink-statebackend-rocksdb_2.11</artifactId&gt;
 <version&gt;1.11.2</version&gt;
 <!-<scope&gt;test</scope&gt;-&gt;
 </dependency&gt;
 
<dependency&gt;
 <groupId&gt;org.apache.hadoop</groupId&gt;
 <artifactId&gt;hadoop-client</artifactId&gt;
 <version&gt;3.3.0</version&gt;
 </dependency&gt;
 
<dependency&gt;
 <groupId&gt;org.apache.flink</groupId&gt;
 <artifactId&gt;flink-core</artifactId&gt;
 <version&gt;1.11.1</version&gt;
 </dependency&gt;
 
<!-<dependency&gt;-&gt;
 <!-<groupId&gt;org.slf4j</groupId&gt;-&gt;
 <!-<artifactId&gt;slf4j-simple</artifactId&gt;-&gt;
 <!-<version&gt;1.7.25</version&gt;-&gt;
 <!-<scope&gt;compile</scope&gt;-&gt;
 <!-</dependency&gt;-&gt;
 
<!-- https://mvnrepository.com/artifact/org.apache.flink/flink-cep --&gt;
 <dependency&gt;
 <groupId&gt;org.apache.flink</groupId&gt;
 <artifactId&gt;flink-cep_2.11</artifactId&gt;
 <version&gt;1.11.1</version&gt;
 </dependency&gt;
 
<dependency&gt;
 <groupId&gt;org.apache.flink</groupId&gt;
 <artifactId&gt;flink-cep-scala_2.11</artifactId&gt;
 <version&gt;1.11.1</version&gt;
 </dependency&gt;
 
<dependency&gt;
 <groupId&gt;org.apache.flink</groupId&gt;
 <artifactId&gt;flink-scala_2.11</artifactId&gt;
 <version&gt;1.11.1</version&gt;
 </dependency&gt;
 
&nbsp;
 
<dependency&gt;
 <groupId&gt;org.projectlombok</groupId&gt;
 <artifactId&gt;lombok</artifactId&gt;
 <version&gt;1.18.4</version&gt;
 <!-<scope&gt;provided</scope&gt;-&gt;
 </dependency&gt;
 
</dependencies&gt;
 </project&gt;
 
&nbsp;
 
the error I got is:
 
https://paste.ubuntu.com/p/49HRYXFzR2/
 
&nbsp;
 
some of the above error is:
 
Caused by: java.lang.IllegalStateException: Unexpected state handle type, 
expected: class org.apache.flink.runtime.state.KeyGroupsStateHandle, but found: 
class org.apache.flink.runtime.state.IncrementalRemoteKeyedStateHandle
 
&nbsp;
 
&nbsp;
 
The steps are:
 
1.mvn clean scala:compile compile package
 
2.nc -lk 9999
 
3.flink run -c wordcount_increstate&nbsp; datastream_api-1.0-SNAPSHOT.jar
 Job has been submitted with JobID df6d62a43620f258155b8538ef0ddf1b
 
4.input the following conents in nc -lk 9999
 
before
 error
 error
 error
 error
 
5.
 
flink run -s 
hdfs://Desktop:9000/tmp/flinkck/df6d62a43620f258155b8538ef0ddf1b/chk-22 -c 
StateWordCount datastream_api-1.0-SNAPSHOT.jar
 
Then the above error happens.
 
&nbsp;
 
Please help,Thanks~!




I have tried to subscried to user@flink.apache.org;

but no replies.If possible ,send to appleyu...@foxmail.com with your valuable 
replies,thanks.
 
&nbsp;