Error uploading SVG Font File

Is it normal that on a clean forum without any extras after installing the fonts, the speed of loading the site will increases by almost 2 seconds? This is unacceptable..