Is there a way to display a offline page while setting up as right now my joomla site is in offline mode to build
Yes, there are several topics discussing this, all of which are accessible via the search.
My favorite solution is a two container configuration so that the site isn’t down while the new container rebuilds.