Managing personal message participants

I’m afraid this is currently not possible, but there is an open feature request discussing the issue here: