Yes, check /var/discourse/shared/standalone/log/var-log/nginx/access.log.
Yes, the slow down crawler user agents site setting.
Looks like what you had was I/O wait during the 9:40 peak. Increasing RAM may help as more stuff can be kept at cache, but I don’t know if that peak was read or write, as you did cut off the graph legend
.
That said, if you can afford, increasing the droplet size to the next available size will always help.