I think swiping on the title bar would make more sense and have less risk of causing disorientation. It would look something like this mid-swipe:
