This is very likely coming from the Rails stack (not Discourse), very likely complicated to work around.
I can see some assertions in actionpack for 406 status.
Going to recategorize this as Contribute > Feature for now, since there is a trivial workaround and appears to be by design in Rails.