AWS S3 Backup hoog aantal POST-verzoeken

AI-generated summary

Drakon74 set up AWS S3 for Discourse backups and received a warning from AWS after three days due to 2,000 POST requests exceeding the free tier limit, despite only one nightly backup. The backup size is 2.3 GB. pfaffman speculated that large files are uploaded in small chunks, leading to many POSTs. gerhard confirmed this, explaining that files over 15 MB are split into ~5 MB chunks, making the high request count normal. Drakon74 acknowledged the explanation, relieved that the behavior is expected and the setup is working correctly.

Hello,

i recently configured the Backup in my discourse software to use AWS S3. It is only used for the backup process, File uploads are still stored server side. The backup process works and happens every night once. I set up an AWS Account and Bucket just for this.

However, by just 3 days AWS gave me a warning email, that my free contingent of POST requests is used up. The AWS Dashboard says, there have been exactly 2000 POST requests in those 3 days (since i set up the backup). This number seems very very high and basically unbelievable.

AWS also states a 163 GET requests, which seems far more believable.

Any Idea why those POST requests appear so high? Did i configured something wrong maybe? I used the tutorials from his site here.

How big is your backup? My guess is that each POST contains some small number of MB, so it takes a bunch to POST one backup.

2.3 GB currently.

Yeah i had the same thought too a moment ago. Though would this be a normal behavior?

Large files (>15 MB) like backups are uploaded in small chunks (usually 5 MB), so the number of requests seems reasonable.

Then the chunks are smaller than i thought :sweat_smile:

Well, if it’s all working correctly, then all is good. Just got worried for a second there. Thanks for the help guys!