Blacklist is probably the way to go. Like @eviltrout, I’ve seen sites block HEAD, too. I think some naive site owners think HEAD is just for useless bots.
elijah
(Eli the Bearded)
5
Related topics
| Topic | Replies | Views | Activity | |
|---|---|---|---|---|
| Did onebox change? They're not showing for my main site any longer | 6 | 1494 | June 6, 2017 | |
| Onebox previews are not working for my site | 4 | 323 | February 23, 2024 | |
| Oneboxing of sites with hash (#) in URL not working | 7 | 2010 | July 29, 2017 | |
| Onebox no longer works for my wordpress site | 11 | 1917 | June 12, 2017 | |
| Onebox issue with a specific site | 13 | 1851 | January 31, 2019 |