We've finally merged the fix for the bug you've reported here (
https://issues.apache.org/jira/browse/FLINK-2543).
You should now be able to use the file-based state handle with user classes
as well.
Please let us know if you encounter more issues.
On Wed, Aug 19, 2015 at 10:20 AM, Rico Bergmann
Hi.
Thanks for the tip. It seems to work...
Greets.
> Am 18.08.2015 um 13:56 schrieb Stephan Ewen :
>
> Yep, that is a valid bug!
> State is apparently not resolved with the correct classloader.
>
> As a workaround, you can checkpoint byte arrays and serialize/deserialize the
> state into
The head Revision of 0.10-SNAPSHOT.
> Am 18.08.2015 um 17:10 schrieb Robert Metzger :
>
> I'm still working on writing a test case for reproducing the issue.
> Which Flink version are you using?
> If you are using 0.10-SNAPSHOT, which exact commit?
>
>> On Tue, Aug 18, 2015 at 2:09 PM, Robert
I'm still working on writing a test case for reproducing the issue.
Which Flink version are you using?
If you are using 0.10-SNAPSHOT, which exact commit?
On Tue, Aug 18, 2015 at 2:09 PM, Robert Metzger wrote:
> I created a JIRA for the issue:
> https://issues.apache.org/jira/browse/FLINK-2543
>
I created a JIRA for the issue:
https://issues.apache.org/jira/browse/FLINK-2543
Once I'm done with the Kafka pull request, I'll take a look into this.
On Tue, Aug 18, 2015 at 1:56 PM, Stephan Ewen wrote:
> Yep, that is a valid bug!
> State is apparently not resolved with the correct classloade
Yep, that is a valid bug!
State is apparently not resolved with the correct classloader.
As a workaround, you can checkpoint byte arrays and serialize/deserialize
the state into byte arrays yourself. You can use the apache commons
SerializationUtil class, or Flinks InstantiationUtil class for that
Java's HashMap is serializable.
If it is only the map, you can just use the HashMap<> as the state.
If you have more data, you can use TupleX, for example:
Tuple2, Long>(myMap, myLong);
On Tue, Aug 18, 2015 at 12:21 PM, Rico Bergmann
wrote:
> Hi!
>
> Using TupleX is not possible since the sta
Hi Marton.
I think this is more a class loader issue. My custom class implements
Serializable and so do all contained members classes.
Greets. Rico.
> Am 18.08.2015 um 11:45 schrieb Márton Balassi :
>
> Hey Rico,
>
> Currently the Checkpointed interface has the limitation the return type
Hi!
Using TupleX is not possible since the state is very big (a Hashtable).
How would I have to do serialization into a byte array?
Greets. Rico.
> Am 18.08.2015 um 11:44 schrieb Robert Metzger :
>
> Hi Rico,
>
> I'm pretty sure that this is a valid bug you've found, since this case is no
Hey Rico,
Currently the Checkpointed interface has the limitation the return type of
the snapshotstate method (the generic paramter of Checkpointed) has to be
java Serializable. I suspect that is the problem here. This is a limitation
that we plan to lift soon.
Marton
On Tue, Aug 18, 2015 at 11:
Hi Rico,
I'm pretty sure that this is a valid bug you've found, since this case is
not yet tested (afaik).
We'll fix the issue asap, until then, are you able to encapsulate your
state in something that is available in Flink, for example a TupleX or just
serialize it yourself into a byte[] ?
On Tu
Hi!
Is it possible to use your own class?
I'm using the file state handler at the Jobmanager and implemented the
Checkpointed interface.
I tried this and got an exception:
Error: java.lang.RuntimeException: Failed to deserialize state handle and setup
initial operator state.
at org.apache.flin
12 matches
Mail list logo
