Can't find Upgrade Discourse button after last upgrade

No, the ‘update’ tab should always be there even if there are no current updates to take advantage of. It comes from the docker manager plugin.

Can you access the page directly? [YourSite]/admin/update