# Scrape a discourse forum with python

**URL:** <https://meta.discourse.org/t/scrape-a-discourse-forum-with-python/98520>\
**Category:** Development\
**Created:** [October 2, 2018, 2:28am UTC](https://meta.discourse.org/t/scrape-a-discourse-forum-with-python/98520 "2018-10-02T02:28:47Z")\
**Posts on this page:** 1\
**Showing post:** 2

<div class="post-metadata">

**Author:** ![pfaffman](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/pfaffman/32/120154_2.png) [@pfaffman](https://meta.discourse.org/u/pfaffman)\
**Post date:** [October 2, 2018, 1:27pm UTC](https://meta.discourse.org/t/scrape-a-discourse-forum-with-python/98520/2 "2018-10-02T13:27:00Z")

</div>

If access the raw markdown pages you won’t have to parse html and will have the URLs without accessing the counters. This topic is [https://meta.discourse.org/raw/98520](https://meta.discourse.org/raw/98520).

Edit: like others say, the API is really what you want. Here’s the scraper I wrote: [GitHub - pfaffman/discourse-downloader: Download a Discourse topic for offline analysis · GitHub](https://github.com/pfaffman/discourse-downloader)

---

_[View the full topic](https://meta.discourse.org/t/scrape-a-discourse-forum-with-python/98520)._