Is there anyway to prevent search engines like google from indexing pdf files? I know that we can do something like <Files ~ "\.pdf$"> Header set X-Robots-Tag "noindex, nofollow" </Files> in htaccess for normal websites. But how this is possible for discourse?

Prevent google from indexing pdf files

codinghorror (Jeff Atwood) July 30, 2019, 6:16am 5

It is possible to manually edit robots.txt now. You can add

Disallow: /*.pdf

to your robots.txt

4 Likes

Topic		Replies	Views
No-index for categories Support	0	353	April 7, 2021
Robots.txt to completely block all indexing of private site Support	5	828	April 5, 2020
How to noindex all pages to keep them out of Google indexes Support	8	2628	February 22, 2024
How to edit robot.txt for indexing user profiles? Support	9	864	June 8, 2023
I have indexed my site to google and get error “No: ‘noindex’ detected in ‘X-Robots-Tag’”. How to remove this header tag? Data & reporting analytics	4	896	April 24, 2025