If it persists during safe mode then it’s unlikely a theme or a plugin and is more likely a site setting.
I can’t access https://aisverige.se/signup by visiting the URL directly which indicates it’s not limited to a button display issue… another site setting to check would be Allow new registrations… is that disabled?