Re: Keyed CEP checkpoint fails

2017-08-10 Thread Daiqing Li
Hi Dawid, After rewriting dashcode with Objects.hash for all the fields, I still get the same error. One thing special is checkpoints always fail at 428, after trying many times. Does it mean anything? > On Aug 10, 2017, at 9:14 AM, Dawid Wysakowicz > wrote: > > Yes, with the information I ha

Re: Keyed CEP checkpoint fails

2017-08-10 Thread Dawid Wysakowicz
Yes, with the information I have, the conclusion would be the same, that I think the reason is problem with hashcode. Without some data to reproduce it unfortunately I won’t be able to help you further. I could just advise you to debug the method SharedBuffer#serialize and pay attention to the e

Re: Keyed CEP checkpoint fails

2017-08-10 Thread Daiqing Li
Oh sorry, the data in {} is not empty because I hide private information about my model. Do you have that same conclusion? > On Aug 10, 2017, at 8:52 AM, Dawid Wysakowicz > wrote: > > You are right, I won’t be able to reproduce this problem without data. One > thing I can tell though that I th

Re: Keyed CEP checkpoint fails

2017-08-10 Thread Dawid Wysakowicz
You are right, I won’t be able to reproduce this problem without data. One thing I can tell though that I think the problem is indeed with the hashcode. Unforunately I don’t know Gson, but one strange thing I noticed is the exception message: SharedBufferEntry(ValueTimeWrapper({}, 1502298303586,

Re: Keyed CEP checkpoint fails

2017-08-10 Thread Daiqing Li
Hi, Here is the code. But I am not sure if you can reproduce the problem without data source. Best, Daiqing On Thu, Aug 10, 2017 at 8:15 AM, Dawid Wysakowicz < wysakowicz.da...@gmail.com> wrote: > As @Kostas asked in your previous thread would be possible for you to > share your code for that j

Re: Keyed CEP checkpoint fails

2017-08-10 Thread Dawid Wysakowicz
As @Kostas asked in your previous thread would be possible for you to share your code for that job or at least a minimal example to reproduce this behaviour. I fear we won’t be able to help you without any further info. Regards, Dawid > On 10 Aug 2017, at 14:10, Daiqing Li wrote: > > Hi Flink

Keyed CEP checkpoint fails

2017-08-10 Thread Daiqing Li
Hi Flink user, I am using FsStateBackend and AWS EMR YARN to run a CEP job. I got this exception after running for a while. Could anyone give me some help to debug this? I try parallelism 1, and it has the same problem. I also try reimplemented hashcode and equals method. I use UUID as hashcode ri