Transactionele E-mailservice (Open Source)

It pretty much works that way already. “suppress digest email after days” site setting.