ate: Friday, September 30, 2016 at 3:58 AM
To: mailto:user@flink.apache.org>>
Cc: Stephan Ewen mailto:se...@apache.org>>
Subject: Re: Error while adding data to RocksDB: No more bytes left
Agree with Stefan, let's see if the fully async snapshot mode helps. It looks
suspiciously RocksD
.DefaultClassResolver.readClass(
> DefaultClassResolver.java:115)
> at com.esotericsoftware.kryo.Kryo.readClass(Kryo.java:641)
> at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752)
> at org.apache.flink.api.java.typeutils.runtime.kryo.
> KryoSerializer.deserialize(KryoSerializer.ja
ricsoftware.kryo.Kryo.readClass(Kryo.java:641)
> at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752)
> at org.apache.flink.api.java.typeutils.runtime.kryo.
> KryoSerializer.deserialize(KryoSerializer.java:232)
> at org.apache.flink.api.scala.typeutils.CaseClassSerializ
ava:641)
> at com.esotericsoftware.kryo.Kryo.readClassAndObject(Kryo.java:752)
> at
> org.apache.flink.api.java.typeutils.runtime.kryo.KryoSerializer.deserialize(KryoSerializer.java:232)
> at
> org.apache.flink.api.scala.typeutils.CaseClassSerializer.deserialize(CaseClassSerializer
er.readName(DefaultClassResolver.java:136)
... 52 more
From: Stephan Ewen mailto:se...@apache.org>>
Date: Wednesday, September 28, 2016 at 1:18 PM
To: mailto:user@flink.apache.org>>
Subject: Re: Error while adding data to RocksDB: No more bytes left
Hi Shannon!
The stack trace you pa
Hi Shannon!
The stack trace you pasted is independent of checkpointing - it seems to be
from the regular processing. Does this only happen when checkpoints are
activated?
Can you also share which checkpoint method you use?
- FullyAsynchronous
- SemiAsynchronous
I think there are two possibil
It appears that when one of my jobs tries to checkpoint, the following
exception is triggered. I am using Flink 1.1.1 in Scala 2.11. RocksDB
checkpoints are being saved to S3.
java.lang.RuntimeException: Error while adding data to RocksDB
at
org.apache.flink.contrib.streaming.state.Rock
