Toggling robots still doesn't create Disallow Directive


(Loren Baum) #1


(Sam Saffron) #2

This works, I just tested it.

  1. Disables: allow index in robots txt in site settings
  2. Looked at http://example.com/robots.txt and saw everything is disallowed

(Loren Baum) #3

did you check using this tool?

http://www.frobee.com/robots-txt-check