One thing that did just come to mind is possibly every time I'm submitting a job from a previous checkpoint with different settings, it has to slowly re-checkpoint all the previous data. Which means there would be some warm up time before things functioned in a steady state. Is this possible?
On Wed, Jan 13, 2021 at 6:09 PM Rex Fenley <r...@remind101.com> wrote: > Hello, > > I have incremental checkpoints turned on and there seems to be no relation > at all to how often the job checkpoints and how much data exists. Whether > checkpoints are set to every 1 min or every 5 seconds they're still around > 5 GB in size and checkpoint times are still in minutes. I would expect that > if the system only runs for 5s then it would have significantly less data > to checkpoint than if it runs for 1 min. > > Would someone mind clarifying the meaning of checkpoint data size when > incremental checkpoints are turned on? Possibly I'm misinterpreting it. > > Thank you! > > -- > > Rex Fenley | Software Engineer - Mobile and Backend > > > Remind.com <https://www.remind.com/> | BLOG <http://blog.remind.com/> | > FOLLOW US <https://twitter.com/remindhq> | LIKE US > <https://www.facebook.com/remindhq> > -- Rex Fenley | Software Engineer - Mobile and Backend Remind.com <https://www.remind.com/> | BLOG <http://blog.remind.com/> | FOLLOW US <https://twitter.com/remindhq> | LIKE US <https://www.facebook.com/remindhq>
