Hi,
Can I build two sliding windows in parallel from the same Dstream ? Will
these two window streams run in parallel and process the same data? I wish
to do two different functions (aggregration on one window and storage for
the other window) across the same original dstream data though the same
window sizes.
JavaPairReceiverInputDStream<String, String> messages =
KafkaUtils.createStream(jssc, args[0], args[1], topicMap);
Duration windowLength = new Duration(30000);
Duration slideInterval = new Duration(30000);
JavaPairDStream<String,String> windowMessages1 =
messages.window(windowLength,slideInterval);
JavaPairDStream<String,String> windowMessages2 =
messages.window(windowLength,slideInterval);
Thanks,
Josh