You might find that the category still shows if it contains topics, move the topics out into another category.