You’d need to turn off any OAuth methods too of course, but yes that could work nicely. Just be careful you don’t log off yourself (e.g. restore the site) inadvertently.
Although in that case you can simply turn logins back on from the console. Are you planning this for meta 
?