Re: Streaming Exception

2017-03-11 Thread Robert Metzger
Are you sure you checked the taskmanager with id 383f6af3299793ba73eeb7bdbab0ddc7? It should log something at the time of the error, otherwise, this would be very weird. On Sat, Mar 11, 2017 at 12:01 AM, Govindarajan Srinivasaraghavan < govindragh...@gmail.com> wrote: > This is the exception befo

Re: Streaming Exception

2017-03-10 Thread Govindarajan Srinivasaraghavan
This is the exception before the job went into cancelled state. But when I looked into the task manager node, the flink process is still running. java.lang.Exception: TaskManager was lost/killed: 383f6af3299793ba73eeb7bdbab0ddc7 @ ip-xx.xx.xxx.xx.us-west-2.compute.internal (dataPort=37652)

Re: Streaming Exception

2017-03-10 Thread Robert Metzger
Hi, this error is only logged at WARN level. As Kaibo already said, its not a critical issue. Can you send some more messages from your log. Usually the Jobmanager logs why a taskmanager has failed. And the last few log messages of the failed TM itself are also often helpful. On Fri, Mar 10, 2

Re: Streaming Exception

2017-03-10 Thread Kaibo Zhou
I think this is not the root cause of job failure, this task is caused by other tasks failing. You can check the log of the first failed task. 2017-03-10 12:25 GMT+08:00 Govindarajan Srinivasaraghavan < govindragh...@gmail.com>: > Hi All, > > I see the below error after running my streaming job f

Streaming Exception

2017-03-09 Thread Govindarajan Srinivasaraghavan
Hi All, I see the below error after running my streaming job for a while and when the load increases. After a while the task manager becomes completely dead and the job keeps on restarting. Also when I checked if there is an back pressure in the UI, it kept on saying sampling in progress and no r

Re: Streaming Exception error message Explanation

2016-07-07 Thread Márton Balassi
Hi Subash, Unfortunately you can not reference a DataStream (loop) within a Flink operator. To handle both casual and feedback data I suggest using CoOperators. Have a look at this mockup I did some time ago for a conceptually similar problem. [1] [1] https://github.com/streamline-eu/ML-Pipelines

Streaming Exception error message Explanation

2016-07-06 Thread subash basnet
Hello all, I have been trying to read the stock data as a stream and perform outlier detection upon it. My problem is mainly due to the absence of 'withBroadcastSet()' in DataStream API I used global variable and DataStreamUtils to read the variable *loop*. But I get cast exceptions and others. Co