Happy to hear that!
On Thu, Jan 5, 2017 at 1:34 PM, Paulo Cezar wrote:
> Hi Stephan, thanks for your support.
>
> I was able to track the problem a few days ago. Unirest was the one to
> blame, I was using it on some mapfuncionts to connect to external services
> and for some reason it was usi
Hi Stephan, thanks for your support.
I was able to track the problem a few days ago. Unirest was the one to
blame, I was using it on some mapfuncionts to connect to external services
and for some reason it was using insane amounts of virtual memory.
Paulo Cezar
On Mon, Dec 19, 2016 at 11:30 AM S
Hi Paulo!
Hmm, interesting. The high discrepancy between virtual and physical memory
usually means that the process either maps large files into memory, or that
it pre-allocates a lot of memory without immediately using it.
Neither of these things are done by Flink.
Could this be an effect of eit
- Are you using RocksDB?
No.
- What is your flink configuration, especially around memory settings?
I'm using default config with 2GB for jobmanager and 5GB for taskmanagers.
I'm starting flink via "./bin/yarn-session.sh -d -n 5 -jm 2048 -tm 5120 -s
4 -nm 'Flink'"
- What do you use for T
Also, can you tell us what OS you are running on?
On Fri, Dec 16, 2016 at 6:23 PM, Stephan Ewen wrote:
> Hi!
>
> To diagnose this a little better, can you help us with the following info:
>
> - Are you using RocksDB?
> - What is your flink configuration, especially around memory settings?
>
Hi!
To diagnose this a little better, can you help us with the following info:
- Are you using RocksDB?
- What is your flink configuration, especially around memory settings?
- What do you use for TaskManager heap size? Any manual value, or do you
let Flink/Yarn set it automatically based o
