If all sites can use the same plugins and same SMTP config, then multisite is what you want.
If you diffeernt anything, then you’ll need a separate container for each site. Note: I’d have a single database container to handle all of the separate site web-only containers.