Any way to turn off RateLimiter temporarily for bulk creation by admin?

What I’d likely do is run a script in the Rails console. Have you checked out: Available settings for global rate limits and throttling? It looks like you can change those rate limits.