# How to stop Discourse from crawling/embedding links

**URL:** https://meta.discourse.org/t/how-to-stop-discourse-from-crawling-embedding-links/307951
**Category:** Self-hosting
**Created:** [May 14, 2024, 7:52pm UTC](https://meta.discourse.org/t/how-to-stop-discourse-from-crawling-embedding-links/307951 "2024-05-14T19:52:31Z")
**Posts on this page:** 5
**Page:** 1

<div class="post-metadata">

### Author: ![Genisis](https://avatars.discourse-cdn.com/v4/letter/g/f475e1/32.png) [@Genisis](https://meta.discourse.org/u/Genisis)
#### Post date: [May 14, 2024, 7:52pm UTC](https://meta.discourse.org/t/how-to-stop-discourse-from-crawling-embedding-links/307951/1 "2024-05-14T19:52:31Z")

</div>

I looked up how to stop discourse from crawling/embedding link as to not leak server ip but every post says add nginix behind reverse proxy, im not smart enough to do that, I set it up behind Cloudflare tunnel a day ago and its been working great, a tut on how to only allow cf traffic would be great or how to turn user off embedding.

---

<div class="post-metadata">

### Author: ![Jagster](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/jagster/32/192154_2.png) [@Jagster](https://meta.discourse.org/u/Jagster)
#### Post date: [May 14, 2024, 9:26pm UTC](https://meta.discourse.org/t/how-to-stop-discourse-from-crawling-embedding-links/307951/2 "2024-05-14T21:26:54Z")

</div>

I don’t know, but I’m curious — why hiding IP of a server is important?

---

<div class="post-metadata">

### Author: ![Genisis](https://avatars.discourse-cdn.com/v4/letter/g/f475e1/32.png) [@Genisis](https://meta.discourse.org/u/Genisis)
#### Post date: [May 14, 2024, 9:34pm UTC](https://meta.discourse.org/t/how-to-stop-discourse-from-crawling-embedding-links/307951/3 "2024-05-14T21:34:32Z")

</div>

bad actors can directly ddos ip if they get it, mostly ddos related. we’ve gotten hit before but thanks to Cloudflare it helped.  
for some added context, you can send an ip logger and when it crawls it, they get the IP

---

<div class="post-metadata">

### Author: ![pfaffman](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/pfaffman/32/120154_2.png) [@pfaffman](https://meta.discourse.org/u/pfaffman)
#### Post date: [May 15, 2024, 6:05am UTC](https://meta.discourse.org/t/how-to-stop-discourse-from-crawling-embedding-links/307951/4 "2024-05-15T06:05:41Z")

</div>

Security by obscurity isn’t a solution. You can firewall off the site to all except cloudflare.

---

<div class="post-metadata">

### Author: ![Genisis](https://avatars.discourse-cdn.com/v4/letter/g/f475e1/32.png) [@Genisis](https://meta.discourse.org/u/Genisis)
#### Post date: [May 15, 2024, 11:29am UTC](https://meta.discourse.org/t/how-to-stop-discourse-from-crawling-embedding-links/307951/5 "2024-05-15T11:29:41Z")

</div>

I get that, but for now I’d rather do that, I don’t know how to block all traffic but cloudflare
