[
https://issues.apache.org/jira/browse/KAFKA-8295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18078578#comment-18078578
]
Soumitra Kumar commented on KAFKA-8295:
---------------------------------------
I have filed https://issues.apache.org/jira/browse/FLINK-39455 ticket and
started a discussion on a FLIP
[HERE|[https://lists.apache.org/thread/w0llnl1p25h282g9kkc6cng6blbb7nmh]|https://lists.apache.org/thread/w0llnl1p25h282g9kkc6cng6blbb7nmh].]
If Kafka is using frocksdb, then it will automatically get the enhancement. If
not, let me know I can create a PR for Kafka as well.
> Add merge() operator to State Stores.
> -------------------------------------
>
> Key: KAFKA-8295
> URL: https://issues.apache.org/jira/browse/KAFKA-8295
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Reporter: A. Sophie Blee-Goldman
> Assignee: Sagar Rao
> Priority: Major
>
> In addition to regular put/get/delete RocksDB provides a fourth operation,
> merge. This essentially provides an optimized read/update/write path in a
> single operation. One of the built-in (C++) merge operators exposed over the
> Java API is a counter. We should be able to leverage this for a more
> efficient implementation of count()
>
> (Note: Unfortunately it seems unlikely we can use this to optimize general
> aggregations, even if RocksJava allowed for a custom merge operator, unless
> we provide a way for the user to specify and connect a C++ implemented
> aggregator – otherwise we incur too much cost crossing the jni for a net
> performance benefit)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
