أحتاج لتعديل ملف robots.txt - أين يوجد؟

Osama · 11 يوليو 2019، 8:44م

لقد قمت بإنشاء طلب سحب (PR) لهذا:

github.com/discourse/discourse

FEATURE: Allow customization of robots.txt (#7884)

master ← OsamaSayegh:customize-robots-txt

merged 05:47PM - 15 Jul 19 UTC

OsamaSayegh

+282 -7

This allows admins to customize/override the content of the robots.txt file at …/admin/customize/robots. That page is not linked to anywhere in the UI -- admins have to manually type the URL to access that page. Meta topic: https://meta.discourse.org/t/needing-to-edit-robots-txt-file-where-is-it/93879?u=osama Screenshots: ![image](https://user-images.githubusercontent.com/17474474/61083151-b5174800-a433-11e9-890e-283221046b2b.png) ![image](https://user-images.githubusercontent.com/17474474/61083312-16d7b200-a434-11e9-9cae-dc3a9982c049.png) @eviltrout does it make sense to prepend a comment to robots.txt that says something along the lines of "this robots.txt file has been customized at /admin/customize/robots" **if** the file is customized? It might help with figuring out why certain things are in the file and how to remove/change them?

لقطات الشاشة:

الموضوع		الردود	مرات العرض
Why there are lots of Disallow rule in robots.txt? Product Support	34	4979	22 ديسمبر 2020
Issues Google Search Console is throwing at me for wrong discourse structure (or some for wrong administration of my site) Product Support	18	413	18 ديسمبر 2024
Excluding user profiles in robots.txt (or allow edit of file) Feature	4	2625	24 مايو 2014
Pages listed in the robots.txt are crawled and indexed by Google Product Support	18	3581	30 يوليو 2019
Google notification to remove "noindex" statements from robots.txt Product Support	7	2616	30 يوليو 2019

أحتاج لتعديل ملف robots.txt - أين يوجد؟

الموضوعات ذات الصلة