I changed all the rate limits I could find, but still hit a limit somewhere

Maybe you are hitting the nginx rate limit? You can remove the template for it on one of the first lines of the app.yml file.