Re: how to start tuning to prevent OutOfMemory

2016-07-28 Thread Timo Walther
Hi Istvan, are you running batch or streaming Flink jobs? It is often the user-defined code that creates a lot of objects during runtime. Try to get rid of object creation as much as possible, maybe also a library you are using causes these issues. You might also reduce the size of network bu

how to start tuning to prevent OutOfMemory

2016-07-27 Thread Istvan Soos
Hi, We can see an occasional OOM issue with our Flink jobs. Maybe the input got more diverse, and the grouping has much more keys, not really sure about that part. How do you usually tackle these issues? We are running with parallelism between 5-30. Would it help if we turn that down? We do set