For a very very long time, we disabled all customizations on first load for /admin path. Now that we have safe-mode route I am not sure this is as required. We may change this.
The problem is that people would mess up a customization and then have no idea how to bring site back into operation.