Elias Levy created FLINK-3947: --------------------------------- Summary: Provide low level access to RocksDB state backend Key: FLINK-3947 URL: https://issues.apache.org/jira/browse/FLINK-3947 Project: Flink Issue Type: Improvement Components: state backends Affects Versions: 1.0.3 Reporter: Elias Levy
The current state API is limiting and some implementations are not as efficient as they could be, particularly when working with large states. For instance, a ListState is append only. You cannot remove values from the list. And the RocksDBListState get() implementation reads all list values from RocksDB instead of returning an Iterable that only reads values as needed. Furthermore, RocksDB is an ordered KV store, yet there is no ordered map state API with an ability to iterate over the stored values in order. -- This message was sent by Atlassian JIRA (v6.3.4#6332)