Yes, but that’s in the same league as “it’s better to have more RAM” . And if you don’t have more RAM then you should have swap as a fallback.
No, it won’t be THAT bad. But you said you had really low traffic…