Re: Setup GC log rotate policy for kafka broker servers

2018-12-02 Thread Manikumar
Hi Parth, We need to pass JVM system properties to rotate gc logs. These props added in Kafka 0.11.release. For releases before 0.11, we need to add these JVM props. Broker restart is required for changes to take effect. https://github.com/apache/kafka/blob/trunk/bin/kafka-run-class.sh#L290 On

Session Window emitting null values when converted to stream?

2018-12-02 Thread Liam Clarke
Hi all, Using I am using a session window of 1 minute to detect and prevent duplicated events within the window using reduce() to preserve the first seen value and accumulate how often duplicates were seen, I'm then converting the windowed KTable into a stream to continue processing events. Howe

Re: Session Window emitting null values when converted to stream?

2018-12-02 Thread Matthias J. Sax
The nulls are expected. It's not about expired session windows though: sessions window are stored as `<(key,start-timestamp,end-timestamp), value>`. If the window boundaries changed due to new incoming events (or maybe a merge of two windows due to late arriving records), the window is updated via