Ive been (re)reading this document( http://docs.confluent.io/3.2.0/streams/developer-guide.html#state-stores) hoping to better understand StateStores. At the top of the section there is a tantalizing note implying that one could do deduplication using a store.
At present we using Redis for this as it gives us a shared location. Ive been of the mind that a given store was local to a streams instance. To truly support deduplication I would think one would need access to _all_ the data for a topic and not just on a per-partition basis. Am I completely misunderstanding this?