Re: Kafka stream or ksql design question

2018-07-16 Thread Guozhang Wang
Hello Will, Your question is very high-level and hence I felt less guilty to give you a general answer :) You can read the web docs on on Kafka Streams achieve high throughput via data parallelism here: https://kafka.apache.org/11/documentation/streams/architecture Regarding KSQL, you can look

Kafka stream or ksql design question

2018-07-16 Thread Will Du
Hi folks, As far as I know, Kafka Stream is a separate process by reading data from topic, transform, and writing to another topic if needed. In this case, how this process supports high throughout stream as well as load balance in terms of message traffic and computing resource for stream proce