Would changing the search priority in the category settings work for you? That could make it way more likely for users to find topics from that category. You can experience that here on Meta by searching in support, which has a low priority so you find most topics from the subcategories like self-hosting.
Otherwise, I think you need a custom theme component to change the search experience for your users.
