The current behavior is by design. But I can see how it would be useful to allow members who are not moderators or admins to specify the topic when creating an invite, so I slipped this across to Feature so it can be considered.
People want to set up their invite system in all sorts of ways. I talked to someone not too long ago who wanted to be able to set a default topic and not allow members to change it.