Re: Writing streams to kafka topic

2017-09-02 Thread Praveen
Thanks. I was able to quickly build a simple example out of this. Also saw the issue with punctuate and your “tick” feed recommendation for now. - Praveen On Fri, Sep 1, 2017 at 9:48 AM, Matthias J. Sax wrote: > Hi, > > this is not supported by the DSL layer. What you would need to do, is to >

Re: Writing streams to kafka topic

2017-09-01 Thread Matthias J. Sax
Hi, this is not supported by the DSL layer. What you would need to do, is to add a custom stateful transform() operator after there window (`stream.groupByKey().aggregate().toStream().transform().to()`), that buffers the output and remembers the latest result. Second, you would schedule a punctuat

Writing streams to kafka topic

2017-08-31 Thread Praveen
Hi, I have a use case where I want to schedule processing of events in the future. I am not really sure if this a proper use of stream processing application. But I was looking at KTable and kafka streams api to see if this was possible. So far the pattern I have is: FEED -> changelog stream