How to mass remove PMs?

This should be possible using the UI, just in case that’s a preferred way.

If you use the search filter in:all-pms, along with the title or keywords from your automated message, that should bring them up in the search results. You can then apply the bulk actions and delete them from the results page.