Hi I am not a big fan of kafka connect.
I had use case for kafka messages that needed to be written to MongoDb. The available third party connectors were less than ideal. To me a well written Kafka consumer is simpler and better longer term solution instead of an additional moving part and additional programming model of Kafka connect. Keep it simple with topics , producers and consumers. regards On Thu, Dec 21, 2017 at 2:49 AM, Mads Tandrup < mads.tand...@schneider-electric.com> wrote: > Hi > > Sorry for the simple question. I’m just starting to learn about Kafka > streams and connect and I’m struggling to understand the exact difference > and which one to use. I’m coming from Apache Storm so forgive me if I make > false assumptions. > > I have a use case where I have a Kafka topic with some messages. What I > need to do: > 1. Read the messages > 2. Split and map the message into a number of rows > 3. Write the rows to Cassandra > > It seems the first 2 steps are a natural fit for Kafka Streams. But it > seems the way to write to Cassandra is to use Kafka Connect. > Is that correctly understood? > > Is there any way to connect Kafka Streams and Kafka Connect without > writing it to a new kafka topic? Since the transformation in step 2 is so > simple it seems a waste to write it to disk. > > Is there any other way I should consider? > > Best regards, > Mads > > -- http://khangaonkar.blogspot.com/
