You have already identified the solution. You don’t need a plugin. Adding a few lines to your app.yml is easy and requires no plugin.
See Serve Discourse from a subfolder (path prefix) instead of a subdomain for examples of how to modify the nginx config in the yml file.