Do I need to check if app.yml needs to be modified before every rebuild upgrade?

Be sure you don’t have any pinned versions - there are several places a person might have customised an app.yml which would pin a version.