I found a couple of topics:
https://meta.discourse.org/t/username-restrictions/126664
It’s probably going to be alot more than just exclamation marks. Seems such a strange limitation, since you can use those characters anywhere else.
Anyway, thank you for your help.