You could try temporarily Unlisting the topic or moving it to a Message. Post a reply addressing your concerns, Then once to your satisfaction delete any back and forth posts and relist / move back to a public category.
For the most part Unlisted is not discoverable, but if a link to it is followed it could get replies whereas a message could not.