I found this post after a bit more searching.
Didn’t realize there was a Silencing feature like that. That seems like it would work for Island access, and the Suspended users would be the equivalent to no Island access. So I guess I answered my own question. Sorry about that.