That’s coming from our official calendar plugin:
The mods/admins could essentially “clock out” each day in the holiday calendar topic, posting the timeframe they expect to be offline. It’s not exactly an off duty button, but it’s something that’s already built and can achieve a similar effect.