I've been looking at upgrading my cluster from 1.1.0 to 2.3.1. While testing, I've noticed that shutting brokers down seems to take consistently longer on 2.3.1. Specifically, the process of 'creating snapshots' seems to take several times longer than it did on 1.1.0. On a small testing setup, the time needed to create snapshots and shut down goes from ~20s to ~120s; with production-scale data, it goes from ~2min to ~30min.
To allow myself to roll back, I'm still using the 1.1 versions of the inter-broker protocol and the message format - is it possible that those could slow things down in 2.3.1? If not, any ideas what else could be at fault, or what I could do to narrow down the issue further? Thanks! -Nicholas