Handling of crawler throttling

Falco · September 12, 2023, 6:15pm

I think what you looking for is

app/controllers/application_controller.rb

85fddf58b


      
          rescue_from RateLimiter::LimitExceeded do |e|
            retry_time_in_seconds = e&.available_in
          
            response_headers = { "Retry-After": retry_time_in_seconds.to_s }
          
            response_headers["Discourse-Rate-Limit-Error-Code"] = e.error_code if e&.error_code
          
            with_resolved_locale do
              render_json_error(
                e.description,
                type: :rate_limit,
                status: 429,
                extras: {
                  wait_seconds: retry_time_in_seconds,
                  time_left: e&.time_left,
                },
                headers: response_headers,
              )
            end
          end

Which is the “global” controller rescue for that error that sets the status code.

Topic		Replies	Views
Discourse API Generating 429 Product Support	6	764	March 28, 2023
429 too many requests Self-hosting	4	2898	September 13, 2019
The only solution I have found to workaround «429 Too Many Requests» failure from rubygems.org Product Support	4	2639	October 27, 2017
User_10_secs_limit Development	6	388	July 10, 2025
Understanding /logs/report_js_error 429 Product Support	2	1065	February 16, 2020

Handling of crawler throttling

Related topics