EDIT: I think I worked out how this happens.
It’s not really following convention, or rather perhaps too much.
The issue is if you reference the rake file in plugin.rb it seems to run twice, but the rake task is included even if you don’t reference it, so no need to load it during initialisation.