Got it, the app.yml flag I was talking about seems to lift nginx ratelimits (DISCOURSE_MAX_REQS_PER_IP_EXCEPTIONS)
DISCOURSE_MAX_REQS_PER_IP_EXCEPTIONS
The topic below made it a bit more clear to me: