Yes, that would probably help.
env:
UNICORN_WORKERS: 8
in the app.yml will do this.
I recommend pulling performance numbers using the prometheus plugin if you have that set up, or you can use performance headers.
Analysing your web logs should help a lot with identifying why your server is so busy; looks like crawlers are a good place to start.