Re: kafka streams docs about topology picture only one source node

2017-06-08 Thread john cheng
Tks matthias, I did't consider about the situation you mentioned. you're right. one or more input topic can add to one single source node: builder.addSource("source-1", "topic-1", "topic-2"); Or they can add to different source node: builder.addSource("source-1", "topic-1"); builder.addSource("sou

Re: kafka streams docs about topology picture only one source node

2017-06-08 Thread Matthias J. Sax
Well. You can also ready multiple topics as a single KStream. > builder.stream("topic-1", "topic-2") Of course both topics must contain data with same key and value type. For this pattern, there is only one source node. There is no 1-to-1 relationship between input topics and source node, and th

kafka streams docs about topology picture only one source node

2017-06-08 Thread john cheng
Kafka streams topology can define one or many SourceNode. The picture on official document < http://kafka.apache.org/0102/documentation/streams#streams_architecture_tasks > only draw one source node in some place: 1. Stream Partitions and Tasks 2. Threading Model 3. Local StateStore And the topolo