You should be able to identify PMs where that has been done using a Data Explorer query - just focus on the automated post that occurs when a user removes themselves.
To be super clever, you could even automate it via a badge query. Repeat offenders would rapidly become apparent!