Rate limits on getting a single topic

Dev
1

I am trying a pull all topics into an elasticsearch instance to enable them to be searchable from our main website.

One issue I have is I keep hitting a rate limit that responds with an empty string. I haveset up an interval to request a topic as little as once a second, but I still hit a rate limiter.

Is there an endpoint that would give me a page of topics in the same detail as /t/{topic.id}.json, maybe something to paginate through? I am upwards of 5000 single topic calls, and I haven’t even finished one category yet.

2

Hi Bouncey welcome to the forum

That sounds like a very painful process.
Might it be better to write something up that does an export / import directly using the databases?

1 Like