I think you’re hitting the nail on the head here. This is mostly a qualitative rather than a quantitative thing.
I’ve had really useful contributors with a few posts per month and I’ve had useless ones with a few dozen per week. The leaderboard is a great starting place to separate the wheat from the chaff, but in the end it’ll be your judgement as a community manager 