Re: Questions about state stores and KSQL

2018-07-15 Thread Matthias J. Sax
To understand joins better, you might want to check out: https://www.confluent.io/blog/crossing-streams-joins-apache-kafka/ KSQL uses the same join semantics as Kafka Streams. -Matthias On 7/11/18 8:01 AM, Guozhang Wang wrote: > Hello Jonathan, > > At the very high-level, KSQL statements is c

Re: Questions about state stores and KSQL

2018-07-11 Thread Guozhang Wang
Hello Jonathan, At the very high-level, KSQL statements is compiled into a Kafka Streams topology for execution. And the concept "state stores" are for Kafka Streams, not for KSQL, where inside the topology for those processor nodes that need stateful processing, like Joins, one or more state stor

Questions about state stores and KSQL

2018-07-11 Thread Jonathan Roy
Hi Kafka users, I am very new to Kafka and more globally to stream processing, and am trying to understand some of the concepts used by Kafka. From what I understand, a key-value state store is created on each processor node that performs stateful operations such as aggregations or joins. Let’s