Re: Simple batch job hangs if run twice

I found out how to dump the stacktrace (using jps & jtrace). Please find attached the stacktrace I got when the job got stuck. Thanks, Yassine 2016-09-23 11:48 GMT+02:00 Fabian Hueske : > Yes, log files and stacktraces are different things. > A stacktrace shows the call hierarchy of all threads

Re: Simple batch job hangs if run twice

Yes, log files and stacktraces are different things. A stacktrace shows the call hierarchy of all threads in a JVM at the time when it is taken. So you can see the method that is currently executed (and from where it was called) when the stacktrace is taken. In case of a deadlock, you see where the

Re: Simple batch job hangs if run twice

Hi Fabian, Not sure if this answers your question, here is the stack I got when debugging the combine and datasource operators when the job got stuck: "DataSource (at main(BatchTest.java:28) (org.apache.flink.api.java.io.TupleCsvInputFormat)) (1/8)" at java.lang.Object.wait(Object.java) at org.ap

Re: Simple batch job hangs if run twice

Hi Yassine, can you share a stacktrace of the job when it got stuck? Thanks, Fabian 2016-09-22 14:03 GMT+02:00 Yassine MARZOUGUI : > The input splits are correctly assgined. I noticed that whenever the job > is stuck, that is because the task *Combine (GroupReduce at > first(DataSet.java:573)) *

Re: Simple batch job hangs if run twice

Can you try running with DEBUG logging level? Then you should see if input splits are assigned. Also, you could try to use a debugger to see what's going on. On Mon, Sep 19, 2016 at 2:04 PM, Yassine MARZOUGUI < y.marzou...@mindlytix.com> wrote: > Hi Chensey, > > I am running Flink 1.1.2, and usin

Re: Simple batch job hangs if run twice

Hi Chensey, I am running Flink 1.1.2, and using NetBeans 8.1. I made a screencast reproducing the problem here: http://recordit.co/P53OnFokN4 . Best, Yassine 2016-09-19 10:04 GMT+02:00 Chesnay Schepler : > No, I can't recall that i had this happen to me. > > I wo

Re: Simple batch job hangs if run twice

No, I can't recall that i had this happen to me. I would enable logging and try again, as well as checking whether the second job is actually running through the WebInterface. If you tell me your NetBeans version i can try to reproduce it. Also, which version of Flink are you using? On 19.09

Re: Simple batch job hangs if run twice

Hmm, this sound like it could be IDE/Windows specific, unfortunately I don't have access to a windows machine. I'll loop in Chesnay how is using windows. Chesnay, do you maybe have an idea what could be the problem? Have you ever encountered this? On Sat, 17 Sep 2016 at 15:30 Yassine MARZOUGUI w

Re: Simple batch job hangs if run twice

Hi Aljoscha, Thanks for your response. By the first time I mean I hit run from the IDE (I am using Netbeans on Windows) the first time after building the program. If then I stop it and run it again (without rebuidling) It is stuck in the state RUNNING. Sometimes I have to rebuild it, or close the

Re: Simple batch job hangs if run twice

Hi, when is the "first time". It seems you have tried this repeatedly so what differentiates a "first time" from the other times? Are you closing your IDE in-between or do you mean running the job a second time within the same program? Cheers, Aljoscha On Fri, 9 Sep 2016 at 16:40 Yassine MARZOUGU

Simple batch job hangs if run twice

Hi all, When I run the following batch job inside the IDE for the first time, it outputs results and switches to FINISHED, but when I run it again it is stuck in the state RUNNING. The csv file size is 160 MB. What could be the reason for this behaviour? public class BatchJob { public static