This is now part done per:
You can historically “unwatch” a category when changing.
However, historically “watching” / “tracking” opens a big can of worms. What if there are 700 thousand topics in a category, setting the read state can be crippling. It would have to have some limits.
I will add untrack tomorrow which should be fairly simple.