That does sound like a bug. I’d think that there are pretty good specs for that case, though. Do you have any plugins that might be changing things?
Could some posts in a public category be referring to private topics?
You can test what digests will get sent for a particular user at /admin/emails/preview summary.