Sounds like I’m right. It would be silly to have latest send a bunch of categories that are not used on the outage. I think what I would do is either hard code the categories you want or put them in a theme setting.
You could also make an Ajax call, but that would slow things down.