Following up with a bit more specific color as to what I’m seeing, as well as a
solution that I’m ashamed I didn’t come back to it.
If there is exclusively tier3 work queued up, gang scheduling never comes into
play.
If there is tier3+tier1 work queued up, tier1 gets requeued, and tier3 preempt
I’ve got essentially 3 “tiers” of jobs.
tier1 are stateless and can be requeued
tier2 are stateful and can be suspended
tier3 are “high priority” and can preempt tier1 and tier2 with the requisite
preemption modes.
> $ sacctmgr show qos format=name%10,priority%10,preempt%12,preemptmode%10
>