I agree with this, but I do worry about what happens when you favorite 20 categories. Also, favorite vs watched will be fairly hard to explain.
I think this may be Customization > Plugin area for exploration, uncertain if this belongs in core or not.