I wasn’t scaling out for plugin development, just testing this in a few different scenarios to try to narrow down my issue and make sure I understood it. If the MessageBus is supposed to handle this then I will look into that further.
While debugging, I did notice that app/models/site_setting.rb is still triggering a :site_setting_saved event, which appears to have been removed from the app and replaced with :site_setting_changed. There is nothing listening to the :site_setting_saved event anymore.