Hi Faye,
1) In your sql, different events are for different groups, it seems hard to
extract a global Filter into DataStream.
2) AFAK, you can just drop the retract message (the flag is false), and
then convert the retract stream to append stream.
The downstream job needs to duplicate the records
Sorry just notice I made a typo in the last table (clickAdvertId != null
instead of clickCount !=null)
Table allImpressionTable = impressionsTable
.leftOuterJoin(clicksTable, "clickImpId = impImpressionId && clickMinute
= impMinute")
.groupBy("impAdvertId, impVariationName, impMinute