[
https://issues.apache.org/jira/browse/KAFKA-8295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18078578#comment-18078578
]
Soumitra Kumar edited comment on KAFKA-8295 at 5/6/26 2:58 AM:
---------------------------------------------------------------
I have filed https://issues.apache.org/jira/browse/FLINK-39455 ticket and
started a discussion on a FLIP
[https://lists.apache.org/thread/w0llnl1p25h282g9kkc6cng6blbb7nmh]
If Kafka is using frocksdb, then it will automatically get the enhancement. If
not, let me know I can create a PR for Kafka as well.
was (Author: soumitra):
I have filed https://issues.apache.org/jira/browse/FLINK-39455 ticket and
started a discussion on a FLIP
[HERE|[https://lists.apache.org/thread/w0llnl1p25h282g9kkc6cng6blbb7nmh]]
If Kafka is using frocksdb, then it will automatically get the enhancement. If
not, let me know I can create a PR for Kafka as well.
> Add merge() operator to State Stores.
> -------------------------------------
>
> Key: KAFKA-8295
> URL: https://issues.apache.org/jira/browse/KAFKA-8295
> Project: Kafka
> Issue Type: Improvement
> Components: streams
> Reporter: A. Sophie Blee-Goldman
> Assignee: Sagar Rao
> Priority: Major
>
> In addition to regular put/get/delete RocksDB provides a fourth operation,
> merge. This essentially provides an optimized read/update/write path in a
> single operation. One of the built-in (C++) merge operators exposed over the
> Java API is a counter. We should be able to leverage this for a more
> efficient implementation of count()
>
> (Note: Unfortunately it seems unlikely we can use this to optimize general
> aggregations, even if RocksJava allowed for a custom merge operator, unless
> we provide a way for the user to specify and connect a C++ implemented
> aggregator – otherwise we incur too much cost crossing the jni for a net
> performance benefit)
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
