No, you don’t need to modify app.yml before every rebuild or upgrade.
If your Discourse installation is running fine and you haven’t made any changes to the server configuration, you can continue rebuilding as usual.
It’s still worth checking the official Discourse release notes occasionally, especially for major updates, in case any configuration changes are required.
Also, keeping a backup of your app.yml is a good idea before making changes to it.