On 08.04.20 20:14, Seth Wiesman wrote:
There is a limitation in RocksDB's JNI bridge that will cause applications
to fail if list state exceeds 2GB. I am not aware of anyone working on this
issue.
That is correct, and here's the Jira issue for it:
https://issues.apache.org/jira/browse/FLINK-67
There is a limitation in RocksDB's JNI bridge that will cause applications
to fail if list state exceeds 2GB. I am not aware of anyone working on this
issue.
Seth.
[1] https://github.com/facebook/rocksdb/issues/2383
On Wed, Apr 8, 2020 at 12:02 PM Aaron Levin wrote:
> Hello friendly Flink comm
Hello friendly Flink community!
I'm curious if anyone has operational experience with jobs that store
ListState where occasionally, due to skew, some small number of lists
stored in ListState (stored in RocksDB) will have millions of elements.
Here are the stats:
* millions of keys
* p95 size of
