Hi All, I read through the documentation on Spark Streaming based on event time and how spark handles lags w.r.t processing time and so on.. but what if the lag is too long between the event time and processing time? other words what should I do if I am receiving yesterday's data (the timestamp on message shows yesterday date and time but the processing time is today's time) ? And say I also have a dashboard I want to update in realtime ( as in whenever I get the data) which shows past 5 days worth of data and dashboard just keeps updating.
Thanks, kant
