auto unlist happens as soon as the first post reaches flagging threshold and it is a single post.
Do you have an specific examples of the issue you are having that you can link us to.
I agree with @codinghorror that this is mega rare, before building anything here I think we should look through a few examples of where “auto closing” would have actually helped.