Re: Akka dissassociated

2017-07-19 Thread Bowen Li
The amount of resource assigned to JobManager looks fine. How much resource (CPU and memory) did you allocate for TaskManager? On Wed, Jul 19, 2017 at 3:07 AM, Stephan Ewen wrote: > Hi Greg! > > Akka disassociation means that the network connection between the > JobManager and TaskManager broke.

Re: Akka dissassociated

2017-07-19 Thread Stephan Ewen
Hi Greg! Akka disassociation means that the network connection between the JobManager and TaskManager broke. This can be cause by - actual failures of JobManager / TaskManager (I assume is not the case here) - A limit in the number of open file handles - Network flakeyness - I have seen cases

Akka dissassociated

2017-07-14 Thread Greg Hogan
Hi all, I’m having some issues with Akka running on a modest cluster where increasing the parallelism results in disassociation messages. I am running a batch job, Gelly’s TriangleListing (for simplicity) which is join-based. I have not seen this issue running AdamicAdar which is sort-based. I