Re: OutOfMemoryError in netty local transport

2015-10-01 Thread Maximilian Michels
Great to hear :) On Thu, Oct 1, 2015 at 11:21 AM, Robert Schmidtke wrote: > I pulled the current master branch and rebuilt Flink completely anyway. > Works like a charm. > > On Thu, Oct 1, 2015 at 11:11 AM, Maximilian Michels wrote: >> >> By the way, you might have to use the "-U" flag to force

Re: OutOfMemoryError in netty local transport

2015-10-01 Thread Robert Schmidtke
I pulled the current master branch and rebuilt Flink completely anyway. Works like a charm. On Thu, Oct 1, 2015 at 11:11 AM, Maximilian Michels wrote: > By the way, you might have to use the "-U" flag to force Maven to > update its dependencies: mvn -U clean install -DskipTests > > On Thu, Oct

Re: OutOfMemoryError in netty local transport

2015-10-01 Thread Maximilian Michels
By the way, you might have to use the "-U" flag to force Maven to update its dependencies: mvn -U clean install -DskipTests On Thu, Oct 1, 2015 at 10:19 AM, Robert Schmidtke wrote: > Sweet! I'll pull it straight away. Thanks! > > On Thu, Oct 1, 2015 at 10:18 AM, Maximilian Michels wrote: >> >>

Re: OutOfMemoryError in netty local transport

2015-10-01 Thread Robert Schmidtke
Sweet! I'll pull it straight away. Thanks! On Thu, Oct 1, 2015 at 10:18 AM, Maximilian Michels wrote: > Hi Robert, > > Just a quick update: The issue has been resolved in the latest Maven > 0.10-SNAPSHOT dependency. > > Cheers, > Max > > On Wed, Sep 30, 2015 at 3:19 PM, Robert Schmidtke > wrote

Re: OutOfMemoryError in netty local transport

2015-10-01 Thread Maximilian Michels
Hi Robert, Just a quick update: The issue has been resolved in the latest Maven 0.10-SNAPSHOT dependency. Cheers, Max On Wed, Sep 30, 2015 at 3:19 PM, Robert Schmidtke wrote: > Hi Max, > > thanks for your quick reply. I found the relevant code and commented it out > for testing, seems to be wor

Re: OutOfMemoryError in netty local transport

2015-09-30 Thread Robert Schmidtke
Hi Max, thanks for your quick reply. I found the relevant code and commented it out for testing, seems to be working. Happily waiting for the fix. Thanks again. Robert On Wed, Sep 30, 2015 at 1:42 PM, Maximilian Michels wrote: > Hi Robert, > > This is a regression on the current master due to

Re: OutOfMemoryError in netty local transport

2015-09-30 Thread Maximilian Michels
Hi Robert, This is a regression on the current master due to changes in the way Flink calculates the memory and sets the maximum direct memory size. We introduced these changes when we merged support for off-heap memory. This is not a problem in the way Flink deals with managed memory, just -XX:Ma

Fwd: OutOfMemoryError in netty local transport

2015-09-30 Thread Robert Schmidtke
Hi everyone, I'm constantly running into OutOfMemoryErrors and for the life of me I cannot figure out what's wrong. Let me describe my setup. I'm running the current master branch of Flink on YARN (Hadoop 2.7.0). My job is an unfinished implementation of TPC-H Q2 ( https://github.com/robert-schmid