I figured it out.
The sidekiq task which triggers the trust level groups population is EnsureDbConsistency.
After updating users trust levels from command line (either gaining or losing trust levels), EnsureDbConsistency will move users in and out from these groups.