Re: SIGSEGV error

2021-05-18 Thread Till Rohrmann
Great to hear that you fixed the problem by specifying an explicit serializer for the state. Cheers, Till On Tue, May 18, 2021 at 9:43 AM Joshua Fan wrote: > Hi Till, > I also tried the job without gzip, it came into the same error. > But the problem is solved now. I was about to give up to sol

Re: SIGSEGV error

2021-05-18 Thread Joshua Fan
Hi Till, I also tried the job without gzip, it came into the same error. But the problem is solved now. I was about to give up to solve it, I found the mail at http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/JVM-crash-SIGSEGV-in-ZIP-GetEntry-td17326.html. So I think maybe it was

Re: SIGSEGV error

2021-05-17 Thread Till Rohrmann
Hi Joshua, could you try whether the job also fails when not using the gzip format? This could help us narrow down the culprit. Moreover, you could try to run your job and Flink with Java 11 now. Cheers, Till On Tue, May 18, 2021 at 5:10 AM Joshua Fan wrote: > Hi all, > > Most of the posts say

Re: SIGSEGV error

2021-05-17 Thread Joshua Fan
Hi all, Most of the posts says that "Most of the times, the crashes in ZIP_GetEntry occur when the jar file being accessed has been modified/overwritten while the JVM instance was running. ", but do not know when and which jar file was modified according to the job running in flink. for your info

Re: SIGSEGV error

2019-09-13 Thread Stephan Ewen
Given that the segfault happens in the JVM's ZIP stream code, I am curious is this is a bug in Flink or in the JVM core libs, that happens to be triggered now by newer versions of FLink. I found this on StackOverflow, which looks like it could be related: https://stackoverflow.com/questions/383261

Re: SIGSEGV error

2019-09-13 Thread Till Rohrmann
Hi Marek, could you share the logs statements which happened before the SIGSEGV with us? They might be helpful to understand what happened before. Moreover, it would be helpful to get access to your custom serializer implementations. I'm also pulling in Gordon who worked on the TypeSerializerSnaps