There’s the Delete removed posts after admin setting which controls the time window/delay for how long they stick around. It’s default 24 hours, which does seem a little on the long side. Though I have seen quite a few people use the ‘delete because I made a mistake, edit, and then restore’ flow, so changing that setting to 0 and deleting immediately may be too far in the other direction.
But you can of course have an experiment and adjust to what suits your community best. 
These are actually visible to everyone, not just mods/admins. 