I had tried setting a new icon via System Settings. I did not enter root password in the prompts that appeared, but it turns out the avatar (the ~/.face.icon file) was actually updated. I am on bullseye, not sure if it works the same in buster.
signature.asc
Description: PGP signature