Re: Custom Sink Checkpointing errors

Thanks Stefan. I found the issue in my application. Everything is working as excepted now. Once again thanks for the help and advice. On Fri, Oct 20, 2017 at 4:51 AM, vipul singh wrote: > Thanks Stefan for the answers. The serialization is happening during the > creation of snapshot state. I hav

Re: Custom Sink Checkpointing errors

Thanks Stefan for the answers. The serialization is happening during the creation of snapshot state. I have added a gist with a larger stacktrace( https://gist.github.com/neoeahit/aee5562bf0b8d8d02e2a012f6735d850). I am not using any serializer, in the custom sink. We have src.keyBy(m => (m.topic

Re: Custom Sink Checkpointing errors

Hi, the crash looks unrelated to Flink code from the dump’s trace. Since it happens somewhere in managing a jar file, it might be related to this: https://bugs.openjdk.java.net/browse/JDK-8142508 , point (2). Maybe your jar gets overwritten wh

Custom Sink Checkpointing errors

Hello all, I am working on a custom sink implementation, but having weird issues with checkpointing. I am using a custom ListState to checkpoint, and it looks like this: private var checkpointMessages: ListState[Bucket] =_ My snapshot function looks like: @throws[IOException] def snapshotStat