Could the topics be hidden from latest only when the last post was by the ignored user then? This way all new topics from the ignored users would be hidden, but any replies from other users would still show in latest.
This has become a real issue here on meta lately.