You can compare the category topic id on the category model to the topic id and just exclude the matches.