我可以忽略某些用户代理吗?

given that it’s registered as a crawler, try this