Fabrice, we tested this on a few sites and crawling behavior appears a lot more reasonable.
After this is merged the default throttle will be removed.
Fabrice, we tested this on a few sites and crawling behavior appears a lot more reasonable.
After this is merged the default throttle will be removed.