Hi,
I've been thinking how to solve with Kafka Streams one of my business
process without success for the moment. Hope someone can help me.
I am reading from two topics events like that (I'll simplify the problem at
this point):
ObjectX
Key: String
Value: String
ObjectY
Key: String
Value: String
I want to do some kind of "join" for all events without windowing but also
without being KTables...
Example:
==============================
ObjectX("0001", "a") -> TopicA
Expected output TopicResult:
nothing
==============================
ObjectX("0001", "b") -> Topic A
Expected output TopicResult:
nothing
==============================
ObjectY("0001", "d") -> Topic B:
Expected output TopicResult:
ObjectZ("0001", ("a", "d"))
ObjectZ("0001", ("b", "d"))
==============================
==============================
ObjectY("0001", "e") -> Topic B:
Expected output TopicResult:
ObjectZ("0001", ("a", "e"))
ObjectZ("0001", ("b", "e"))
==============================
TopicResult at the end:
ObjectZ("0001", ("a", "d"))
ObjectZ("0001", ("b", "d"))
ObjectZ("0001", ("a", "e"))
ObjectZ("0001", ("b", "e"))
==============================
I think I can't use KTable-KTable join because I want to match all the
events from the beginning of time. Hence, I can't use KStream-KStream join
because force me to use windowing. Same for KStream-KTable join...
Any expert using Kafka Streams could help me with some tips?
Thanks in advance.
