Users get very touchy about this stuff, I agree that I don’t particularly care if people see my bookmarks, but I have seen pretty loud complaints from the imgur community about this.
At the end of the day I see very little gain in allowing moderators to see everyone’s bookmarks.