Re: Where does RocksDB's mem allocation occur

Sorry resending with proper formatting.. yahoo mail defaults to rich text...and that messes up formatting on this mailing list. Based on my (streaming mode) experiments I see that its not simply on heap and off heap memory. There are actually 3 divisions of memory: 1- On heap  (-Xmx) .  2- Off

Re: Where does RocksDB's mem allocation occur

___ From: Roshan Naik Sent: Saturday, February 23, 2019 10:09 To: dev@flink.apache.org Subject: Where does RocksDB's mem allocation occur For yarn deployments,  Lets say you have  lets say the container size = 10 GB containerized.heap-cutoff-ratio = 0.3  ( = 3GB) That means 7GB is available fo

Re: Where does RocksDB's mem allocation occur

b.com/facebook/rocksdb/wiki/Memory-usage-in-RocksDB#indexes-and-filter-blocks> A library that provides an embeddable, persistent key-value store for fast storage. - facebook/rocksdb github.com Best Yun Tang From: Roshan Naik Sent: Saturday, February 23, 201

Where does RocksDB's mem allocation occur

For yarn deployments,  Lets say you have  lets say the container size = 10 GB containerized.heap-cutoff-ratio = 0.3  ( = 3GB) That means 7GB is available for Flinks various subsystems which include,= jvm heap, and all the DirectByteBufferAllocatins (netty + netw buff + .. ) and Java metadata.  I