This one will not shown during rebuild. I used to create an offline indicator with offline.js that is always checks favicon, makes requests so that shown during rebuild too. But that seems to unnecessary to this feature for me and also can confuse users where is the problem? Server side or with their internet connection.
I believe you can do this with global notice too. Just add a notice before rebuild.