Hi Ram,

You are right, the effect of DefaultRollingPolicy not always rolling on 
checkpoint leads to unusable non-latest savepoints.

My question is, should DefaultRollingPolicy be changed so that it always roll 
on checkpoint to provide a better user experience?
I'd imagine most StreamingFileSink user starts off with DefaultRollingPolicy. 
Users finding that they cannot restore from earlier savepoint when they intend 
to replay events and consequently is a suboptimal experience.

Of course, changing default behaviour may have huge impact, this is also why 
I'd like to understand: what's the motivation behind making 
DefaultRollingPolicy not always roll on checkpoint?
It's worth considering the trade-offs as current default behaviour make 
non-latest savepoints unrestorable .

Thank you
Keith



Reply via email to