In 2.0 you won't be able to do this. The long term vision would be to make this possible, but a window will be required (like the 24 hours you suggest).
On Tue, May 17, 2016 at 1:36 AM, Todd <[email protected]> wrote: > Hi, > We have a requirement to do count(distinct) in a processing batch against > all the streaming data(eg, last 24 hours' data),that is,when we do > count(distinct),we actually want to compute distinct against last 24 hours' > data. > Does structured streaming support this scenario?Thanks! >
