Swiping could be initiated from the middle of the screen, rather than the far sides. This does not trigger side panels on Android or iOS/Safari. Just tested it on both operating systems.
This sort of swiping from the center to navigate already exists on some applications, so it should work out.