Discourse not respecting the number of S3 backups to keep

I just had exactly the same problem and in the last 10 minutes figured out that the reason was that I had somehow turned on s3_disable_cleanup. I think it had to do only with s3 uploads, not backups. But that was wrong.