Regenerating LetsEncrypt keys from behind nginx

Yes. In general, only the outermost layer of your machine needs to deal with SSL.