Hi Stephan,
You can see the snaphots in the earlier mail
When the size of the record increases task managers are getting killed with
the default FLASH_SSD_OPTIMIZED option.
When I tried to set backgroundflushes to 4 and backgroundCompactions to 8 it
ran for more time but then I got the following exception :
AsynchronousException{java.lang.Exception: Could not materialize checkpoint
39 for operator WindowOp
at
org.apache.flink.streaming.runtime.tasks.StreamTask$AsyncCheckpointRunnable.run(StreamTask.java:980)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Regards,
Vinay Patil
--
View this message in context:
http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Re-Checkpointing-with-RocksDB-as-statebackend-tp11752p11799.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at
Nabble.com.
