Do all the locale scripts have to run on install and upgrade?

[codinghorror (Jeff Atwood)]

This is still the source of much pain and makes rebuilds very slow due to all the locales that sites are not using, but yet every single locale has to be processed on every rebuild @sam.