Why might all our users show as "new"?

You could edit the Site Tests to achieve that. However imho it makes sense as it lists users from newest to oldest. Renaming it may also create some confusion as well. If not mistaken active users also lists all users but prioritizes list by rec3bt activity