Re: Structured Stream equivalent of reduceByKey

Hmmm, I see. You could output the delta using flatMapGroupsWithState

Re: Structured Stream equivalent of reduceByKey

Thanks, Michael I have explored Aggregator with update mode. The problem is it will give the overall aggregated value for the changed. while I only want the delta change in the group as the aggre

Re: Structured Stream equivalent of reduceByKey

- dev I think you should be able to write an Aggregator . You probably want to run in update mode if you are looking for it to output any group that has changed in the batch. On Wed, Oct 25, 201