Hi, I’m writing a python script that needs to search in my forum and check if a external link exists in the content of my forum threads. The problem is: i checked manually, it finds some results of posts containing the link and others not. Even though the link is in the post. Would this be something expected?

The raw. Ex: [image] Search by link Development Hi, I’m writing a python script that needs to search in my forum and check if a external link exists in the content of my forum threads. The problem is: i checked manually, it finds some results of posts containing the link and others not. Even though the link is in the post. Would this be something expected? And it’s oneboxed in the op thread. Sometimes it’s works with the same domain but different ending, sometimes not.

Without knowing exactly how you’re searching it’s hard to guess what’s going on. If I were given this task to implement I would probably make a Data Explorer query that searched for any posts with the link in raw or cooked.

for now it’s only a normal search, in site side, like this: [A screenshot of a mobile search result page showing a search bar, a list of results, and some text explaining the results. (Captioned by AI)] In my forum, I just created a topic with 1 link, and I still can’t find the topic by searching for the link. I haven’t tested it here, since I’m not sure if it’s allowed to post links or not.

I’m still testing it. It seems that I can’t search for an entire long link (max 101 characters). So I need to trim it down a bit if it’s longer. Let me know if I’m allowed to post a sample link and if it’s expected behavior

Discourse keeps track of any link inside posts. For your use case, I would use this data. As far as I know, there is no API to access these links. Implementing one via plugin should not be hard.

Thanks for your reply I’m using this automation, It works very well, as long as the link doesn’t exceed 100 characters. If it does, it returns as non-existent, even though there is a topic with that link. async def search_discourse_topic(session, link): headers = {"Api-Key": USER_API_KEY, "Api-Username": USER_ID} cleaned_link = clean_url(link) # Limpa o URL fornecido para garantir consistência try: log(f"Searching for topic with link: {cleaned_link}") # Log quando inicia a pesquisa async with session.get(f"{DISCOURSE_API_URL}/search.json", headers=headers, params={"q": cleaned_link}) as response: search_results = await response.json() topics = search_results.get("topics", []) if not topics: log(f"No topics found for link: {cleaned_link}") # Log se não encontrar resultados for topic in topics: if cleaned_link in topic.get("blurb", ""): # Checa se o link aparece na descrição do tópico log(f"Found existing topic with link: {cleaned_link}") # Log se um tópico correspondente for encontrado return topic["id"] except Exception as e: log(f"Error searching for topic with link: {e}") return None

Search by link

Development

supermathie (Michael Brown) November 30, 2024, 2:06am 2

What are you searching? The raw or cooked?

Topic		Replies	Views
Searching by link address Product Support	5	713	August 20, 2018
Can I send an external URL to the Discourse API for it to return topics linking to that URL? Product Support rest-api	5	352	December 30, 2025
Search existing topics when hyperlinking Feature	8	2061	October 6, 2022
Suggestion - link to existing content faster from the url button Product Support	21	1864	July 23, 2019
Scrape a discourse forum with python Development	4	5288	October 3, 2018

Search by link

Related topics