I haven’t seen this problem happen before, however I believe this might be an easy problem to fix. Before we go any deeper, you should verify the following:
1. Does anybody else on the forum experience the same problem? (If so, it may be #2)
2. Is this favicon reverting problem actually just cache?
3. Does the problem persist in other browsers?
4. Maybe try rebooting the server/rebuilding the container?