In addition to Force people to enter a "reason" when requesting access to a group:
Could the groups setting also allow people to leave freely?
Would need to split this setting into separate settings for join and for leave:
Allow users to join/leave the group freely (Requires group to be visible)
Otherwise, it’s Hotel California
You can check-out any time you like, But you can never leave"