Thanks @Matze, I managed to track down the source of this issue. We were only searching ‘members of groups which you are also a member of’. So that works for ‘staff’ (like we have it here on meta), but it didn’t work for the separate ‘admins’ and ‘moderators’ groups.
https://github.com/discourse/discourse-assign/commit/07c13651c6b5975f9f20d4969faf55c3f5d7a635