This could be time it is taking it to grab static assets ? Maybe have a look in chrome dev tools next time this happens?