I think that it’s also possible to install the PG 14 client stuff inside your container so that the backup tools will work.
Another solution is a two container installation. See How to move from standalone container to separate web and data containers fo rsome information.