Kafka can't by itself do aggregation (nor does it really make sense for it to). You can build such a feature on top of log compaction relatively easily (by sending the new count as a message under an individual key), or you can use the KTable and aggregation features of Kafka Streams.
Thanks Tom Crayford Heroku Kafka On Friday, 5 August 2016, R Krishna <krishna...@gmail.com> wrote: > Is it possible to use Kafka to track counts instead of deletion on > compaction? I know we can aggregate ourself and add it to a different topic > but that won't make sense if the time window is more than few seconds. > > Say, I can then, use it to count based on a key containing minute, hour, > day. > https://cwiki.apache.org/confluence/display/KAFKA/Log+Compaction > > -- > Krishna >
