So here is my issue. I have a requirement to essentially seed a Discourse production instance with around 200 posts at a time from a plugin admin action. These posts will be ‘created by’ 1 of 10 different regular users. The reason it’s a plugin action is because the users of this particular instance…

What I’d likely do is run a script in the Rails console. Have you checked out: Available settings for global rate limits and throttling ? It looks like you can change those rate limits.

This isn’t really a path I want to go down as I want it to initiated by users rather than them relying on me to run a script in the console.

Did you look at the link about changing the rate limits?

Did you figure this out? Modfying the yaml file is not ideal as it requires a rebuild. I’m not familiar enough with rails/discourse to figure out how to disable it temporarily in the console.

what is your use case? What problem are you trying to solve that rate limits are standing in the way of?

Trying to import 60k users via API as fast as possible without doing a rebuild. I also tried on a test installation to raise the ADMIN API limit via YAML, but it didn’t seem to work but maybe I did something wrong. (I’m running imports on the container so the http throttling shouldn’t apply).

This isn’t very helpful, but what I’d do is create the users in rails rather than via the API. discourse/script/import_scripts/csv_importer.rb at main · discourse/discourse · GitHub could be a start. But you can go into the container and edit /var/www/discourse/config/discourse.conf and set those v…

Strange. When I view the conf file the new limit is already set. So the YAML update worked: max_admin_api_reqs_per_key_per_minute = '6000' But it doesn’t seem to work. There’s still a 60 per minute limitation. When I throttle requests to 60 per minute, most go through but due to jitter a few still…

I wonder if it’s an issue with the quotes? You might check SiteSettings.max_admin_api_reqs_per_key_per_minute and see if it’s an integer

in default_current_user_provider.rb (the only file I found that seemed to reference this value, it has: limit = GlobalSetting.max_admin_api_reqs_per_minute.to_i so it does seem to convert it. I even tried replacing with a number in the code.

Any way to turn off RateLimiter temporarily for bulk creation by admin?

Development

Isambard (Isambard) May 27, 2024, 10:47pm 15

I think it is detecting where the request is made from (host computer) but I can work around it by adding a TL2 user on the same IP address (or tweak the IP limit.

Topic		Replies	Views
How do I avoid rate limiting when importing a bunch of data? Development rest-api , rails-console	13	1332	July 6, 2023
Unable to disable the rate limit Self-hosting	2	708	August 2, 2022
Rate limits for API users Development rest-api	11	3293	March 17, 2020
How to bypass rate limiter when using an API key? Self-hosting	13	6526	September 18, 2017
Changing/removing API rate limit with category creation Development rest-api	16	4332	July 31, 2019

Any way to turn off RateLimiter temporarily for bulk creation by admin?

Related topics