Hello again, Kafka users, My end goal is to get stream-processed data into a PostgreSQL database.
I really like the architecture that Kafka Streams takes; it's "just" a library, I can build a normal Java application around it and deal with configuration and orchestration myself. To persist my data, it's easy to add a .foreach() to the end of my topology and upsert data into my DB with jdbc. I'm interpreting based upon the docs that the recommended approach would be to send my final data back to a Kafka topic, and use Connect with a sink to persist that data. That seems really interesting, but it's another complex moving part that I could do without. What advantages does Kafka Connect provide that I would be missing out on by persisting my data directly from my Kafka Streams application? Thanks, Mathieu
