Previous and Next arrows on opened images in posts

On a narrow screen, when we click an image, we have the next and previous arrows shown over the image by default.
This is practical to be able to scroll between images like this, but also can potentially make things ugly (like on an image containing text):