Is creating a second app.yml-like file enough for multisite?

In that case, yes, a second copy of samples/standalone.yml will do fine - but: make sure to update the /var/discourse/shared/[standalone]/ and other host-exposed resources to another name.