Transactional Email Service (Open Source)

It pretty much works that way already. “suppress digest email after days” site setting.