I did it once on a pretty large forum for the same reason. It seemed to work fine.
I think the only way to know how big a hit it would be would be to try. What is “big” how “big” is your server?" How fast? How much RAM? And then there are a bunch of things you could tune.