Could you share what groups you’ve added to that setting?
It should be sending any posts made by people not in the named groups to the review queue for approval:
Posts created by users not in these groups must be approved. Posts created by admins and moderators are always approved.