Hello Alex, Currently Kafka Connect has some simple "T" function on a per-message-basis since 0.10 release, but that may not be sufficient for your use case.
We are planning to have some Kafka Streams / Connect integration in the near future, so that users can specify non-Kafka sources / sinks in their Kafka Streams apps. So if you are OK with this integration that you first pipe the original stream into Kafka via Connect, and does the aggregation inside Streams, then this would work for you. Guozhang On Sun, Jun 26, 2016 at 1:15 PM, Alex Glikson <glik...@il.ibm.com> wrote: > Hi all, > > Would it make sense to use Kafka Streams within Kafka Connect connectors? > For example, if I need to aggregate messages in a sink connector. > Or, alternatively, would it make sense to have the aggregation logic > implemented using Kafka Connect, write the result into a new topic, and > then have a simple sink connector that only dumps aggregated messages? > > Thanks, > Alex > > > -- -- Guozhang
