[ 
https://issues.apache.org/jira/browse/FLINK-9702?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16681078#comment-16681078
 ] 

Stefan Richter commented on FLINK-9702:
---------------------------------------

I think it still makes sense, please consider the link in my previous comment. 
I had already a almost complete implementation that just needs some rebasing I 
guess, no need to start from scratch.

> Improvement in (de)serialization of keys and values for RocksDB state
> ---------------------------------------------------------------------
>
>                 Key: FLINK-9702
>                 URL: https://issues.apache.org/jira/browse/FLINK-9702
>             Project: Flink
>          Issue Type: Improvement
>          Components: State Backends, Checkpointing
>    Affects Versions: 1.6.0
>            Reporter: Stefan Richter
>            Assignee: Congxian Qiu
>            Priority: Major
>
> When Flink interacts with state in RocksDB, object (de)serialization often 
> contributes significantly to performance overhead. I think there are some 
> aspects that we can improve here to reduce the costs in this area. In 
> particular, currently every state has to serialize the backen's current key 
> before each state access. We could reduce this effort by sharing serialized 
> key bytes across all state interactions. Furthermore, we can reduce the 
> amount of  `byte[]` and stream/view that are involved.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Reply via email to