A web crawler is an internet bot which systematically browses the worldwide web typically for the purpose of web indexing web. search engines and some other sites use web crawling or spidering. (Not to confuse with that creature). You can just log out of your account, which will turn you into an anonymous user with no account, and check if you have access or not.