In my experience, Gravatars usually update automatically after a few minutes, at least on sites where I’ve used them. Wordpress sites are great examples.
I think a custom avatar should override that and stay put. It’s like an overriden variable, in an inner scope, which doesn’t change if the outer one does.