Instead of trying to hide IP addresses from moderators, maybe you could just use category moderators to handle the site’s moderation. That way only admins would be able to view IP addresses. Details about Category moderation are here:
There’s a feature request about hiding IP addresses from moderators here: Option to hide IP addresses from moderators.