Re: Connecting to remote task manager failed

2017-07-26 Thread Charith Wickramarachchi
e(BatchTask.java:327) ... 2 more Thanks, Charith On Wed, Jul 26, 2017 at 4:29 AM, Fabian Hueske wrote: > Hi, > > Do you have an exception for the the CoGroup failure? > > Best, Fabian > > 2017-07-26 3:32 GMT+02:00 Charith Wickramarachchi < > charith.dhanus.

Re: Connecting to remote task manager failed

2017-07-25 Thread Charith Wickramarachchi
I did some more digging. It seems the CoGroup operation failed in one of the workers. But I do not face this issue when running other tasks. Thanks, Charith On Tue, Jul 25, 2017 at 2:06 PM, Charith Wickramarachchi < charith.dhanus...@gmail.com> wrote: > Hi All, > > I m getting an

Connecting to remote task manager failed

2017-07-25 Thread Charith Wickramarachchi
Hi All, I m getting an exception when running a Gelly task using Pregel model. It complains that the remote task manager might be lost. But task managers seem to be active based on the flink dashboard. Also, other tasks run fine without an issue. Following is the summary of exception trace. I

Re: Measuring Execution Time

2017-01-16 Thread Charith Wickramarachchi
se to the web interface and > >> check the runtime for each operator there (asumming that each > >> iterative process is a separate operator). > >> > >> Does this help? > >> > >> On Mon, Jan 16, 2017 at 7:36 AM, Charith Wickramarachchi >

Re: Measuring Execution Time

2017-01-16 Thread Charith Wickramarachchi
gt; On Mon, Jan 16, 2017 at 7:36 AM, Charith Wickramarachchi > wrote: > > Hi All, > > > > I have a program that executes multiple (data dependent) iterative jobs > one > > after another in the same execution plan. > > > > It has the following st

Measuring Execution Time

2017-01-15 Thread Charith Wickramarachchi
Hi All, I have a program that executes multiple (data dependent) iterative jobs one after another in the same execution plan. It has the following structure ExecutionEnvironment env = .. LoadData Iterative Process 1 Iterative Process 2 ... Iterative Process N env.execute("...") I wan

Re: HashMap/HashSet Serialization Issue

2017-01-07 Thread Charith Wickramarachchi
ork, though I might be wrong. >> >> This might worth reading >> ​https://cwiki.apache.org/confluence/display/FLINK/Type+Syst >> em,+Type+Extraction,+Serialization >> >> -Chen​ >> >> On Fri, Jan 6, 2017 at 6:06 PM, Charith Wickramarachchi < >> chari

Re: HashMap/HashSet Serialization Issue

2017-01-06 Thread Charith Wickramarachchi
FLINK/Type+ > System,+Type+Extraction,+Serialization > > -Chen​ > > On Fri, Jan 6, 2017 at 6:06 PM, Charith Wickramarachchi < > charith.dhanus...@gmail.com> wrote: > >> Hi All, >> >> I am using flink-gelly and using a custom POJO type as the >>

HashMap/HashSet Serialization Issue

2017-01-06 Thread Charith Wickramarachchi
Hi All, I am using flink-gelly and using a custom POJO type as the VertexValue/MessageType (I am using the vertex-centric model). The POJO contains HashMap/HashSet as members. While executing the job I am getting following Log message. 17:50:53,582 INFO org.apache.flink.api.java.typeutils.TypeEx