Welcome to Meta
Did you try the pin option which Discourse offers by default? I think that’s what you are looking for