The onebox feature in Discourse stopped working for daath on their main site. They investigated and found that the onebox’er sends a HEAD request, which their site does not support, resulting in a 501 Not Implemented error.
eviltrout explained that this is a recent change to improve security with redirects. He planned to modify the onebox’er to try a GET request if the HEAD request receives a 501 error.
eviltrout later fixed the issue, which involved supporting cookies on redirects in addition to trying GET requests. The fix is documented in several GitHub commits:
haha sorry, you’re right - it did prompt me to investigate further.
It looks like the onebox’er sends a HEAD request, which would explain it not working on my site, as I only support GET and POST. Doing a HEAD results in a 501 Not Implemented. When did this change?
Was quite involved. The fix wasn’t as simple as to try HTTP GET, but it also involved supporting cookies on redirects which our more secure redirector did not do. Both are supported now.