CNN 원박스 처리 오류

tgxworld · 5월 8, 2024, 5:33오전

다음 PR로 수정되었습니다.

github.com/discourse/discourse

FIX: Attempt to onebox even if response body exceeds `max_download_kb` (#26929)

main ← fix_dont_throw_away_response_body_when_max_download_exceeded

merged 11:00PM - 08 May 24 UTC

tgxworld

+45 -4

In 95a82d608d6377faf68a0e2c5d9640b043557852, we lowered the default for `Onebox….options.max_download_kb` from 10mb to 2mb for security hardening purposes. However, this resulted in multiple bug reports where seemingly nomral URLs stopped being oneboxed. It turns out that lowering `Onebox.options.max_download_kb` resulted in `Onebox::Helpers::DownloadTooLarge` being raised more often for more URLs in `Onebox::Helpers.fetch_response` which `Onebox::Helpers.fetch_html_doc` relies on. When `Onebox::Helpers::DownloadTooLarge` is raised in `Onebox::Helpers.fetch_response`, we throw away whatever response body which we have already downloaded at that point. This is not ideal because Nokogiri can parse incomplete HTML documents and there is a really high chance that the incomplete HTML document contains the information which we need for generating a reasonable onebox. Therefore, this commit updates `Onebox::Helpers.fetch_html_doc` to not throw away the response body when the size of the response body exceeds `Onebox.options.max_download_size`. Instead, we just take whatever we have and get Nokogiri to parse it.

로컬 환경에서 이 주제에서 보고된 “문제 있는” URL은 이제 onebox 처리를 시도할 때 더 이상 오류를 표시하지 않습니다.

글		댓글	조회수
Issue with Onebox not working for videos larger than 5MB Product Support	0	95	12월 20, 2025
Oneboxing large images fails with no visual cue Bug onebox	46	2282	5월 4, 2023
Onebox links result in large image downloads Feature	2	543	12월 14, 2022
Can't override size of image oneboxes Feature	3	864	6월 18, 2017
Onebox issue with a specific site Product Support onebox	13	1839	1월 31, 2019

CNN 원박스 처리 오류

Related topics