Show total topics count in sidebar

Is there a way to display the total number of topics in that category next to the categories listed in the sidebar?

I noticed there aren’t any plugin outlets there, that’s why I’m asking. (And the fact that I don’t know a way to get all the categories the user adds there, unless it’s possible to override that with a specific list of categories?)