Hello,
According to
http://www.confluent.io/blog/introducing-kafka-streams-stream-processing-made-simple:
“In terms of implementation Kafka Streams stores this derived aggregation in a
local embedded key-value store (RocksDB by default, but you can plug in
anything).”
So I tried running the world count example on my Windows machine (for local
test) and got an error because RocksDB is not available for windows.
I thought it would be easy to switch to an in-memory store.
But after awhile I’ve figured out that the KStream aggregation implementation
doesn’t allow that.
It looks like aggregateByKey (and thus countByKey) is always using a persistent
store.
More over that it looks like there’s no way to change the default persistent
store…
Even though I was more or less capable of achieving the goal using manual
wiring of a Source, a Producer and a Sink – it doesn’t make it for an easy
coding…
The questions that I have are:
- Is there a plan of providing a persistent store support for Kafka
Streams on Windows?
- Is there a plan of providing KStream API to specify a custom
store/factory for aggregations?
- Is there a way of changing the default persistent store from RocksDB?
Best Regards,
Alexander Jipa
