# Now should I only do myself? No. We should both do ourselves

**URL:** https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417
**Category:** Feature
**Created:** [8월 29, 2016, 11:44오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417 "2016-08-29T23:44:20Z")
**Posts on this page:** 18
**Page:** 1

<div class="post-metadata">

### Author: ![elijah](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/elijah/32/104055_2.png) [@elijah](https://meta.discourse.org/u/elijah)
#### Post date: [8월 29, 2016, 11:44오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/1 "2016-08-29T23:44:20Z")

</div>

Apologies for the bad title, but I’m trying to make a point.

Every single word in my title (until someone changes it, and then for the record it was "Now should I only do myself? No. We should both do ourselves. ") is on the Postgres stop words list. **This topic title is invisible to Postgres.** I don’t mind stop words being used for indexing topic bodies, but it irks me a lot to have them used in topic titles. Stop words are sometimes the key words to distinguish one topic from another, so I’d like my searches to be for the terms I’ve put in.

This is not a bug in Discourse, it is just using the [defaults from Postgres](https://meta.discourse.org/t/no-search-result-are-shown/46541), but it does cause user confusion when words get ignored.

Please, please, find a way around the stop list for topic titles.

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [8월 29, 2016, 11:49오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/2 "2016-08-29T23:49:00Z")

</div>

Where has this been an issue _in practice_? I’m not a fan of completely artificial examples.

---

<div class="post-metadata">

### Author: ![elijah](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/elijah/32/104055_2.png) [@elijah](https://meta.discourse.org/u/elijah)
#### Post date: [8월 29, 2016, 11:52오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/3 "2016-08-29T23:52:00Z")

</div>

I have seen forum game topics titled “This or That” which is another completely stopword list title.

And recently I found a book in a book store which has a title that is on _Amazon’s_ stop word list. That issue made me think of this problem again. (The book is titled _The Book_ and is a history of books and related technologies, like paper making.)

---

<div class="post-metadata">

### Author: ![Mittineague](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mittineague/32/114259_2.png) [@Mittineague](https://meta.discourse.org/u/Mittineague)
#### Post date: [8월 30, 2016, 12:07오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/4 "2016-08-30T00:07:34Z")

</div>

> [@elijah](#):
>
> find a way around the stop list for topic titles.

Granted, there will be less topic titles than post content.

But there is good reason for using dictionaries of stop words - **Performance**

Simply having no stop words would likely slow database full text searches to a crawl.

I think if this is a real issue for you, you should look into creating a custom dictionary for your site.

> **[12.6. Dictionaries](https://www.postgresql.org/docs/9.1/textsearch-dictionaries.html)**
>
> 12.6. Dictionaries # 12.6.1. Stop Words 12.6.2. Simple Dictionary 12.6.3. Synonym Dictionary 12.6.4. Thesaurus Dictionary 12.6.5. Ispell Dictionary 12.6.6. Snowball Dictionary …

---

<div class="post-metadata">

### Author: ![elijah](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/elijah/32/104055_2.png) [@elijah](https://meta.discourse.org/u/elijah)
#### Post date: [8월 30, 2016, 12:17오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/5 "2016-08-30T00:17:27Z")

</div>

> [@Mittineague](#):
>
> Simply having no stop words would likely slow database full text searches to a crawl.

I suspect that is not true. For full text, maybe. For titles? That’s a much smaller working space. This forum has around 50k titles if I’m correct in thinking that …ourselves/ **49417** shows me a sequential number. Most of those will have under a dozen words (mine is exactly a dozen). Indexing 600,000 words should not be an issue for a modern system. How many posts here will use the word “Discourse”? The [results cap at 50](https://meta.discourse.org/search?q=discourse), but I bet it is nearer to 50k than 50. (Google tells me “about 17,800” for “site:meta.discourse.org discourse” and I suspect it is an undercount for “posts”.) And yet postgres has no problems searching for a word with that many results.

---

<div class="post-metadata">

### Author: ![Mittineague](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/mittineague/32/114259_2.png) [@Mittineague](https://meta.discourse.org/u/Mittineague)
#### Post date: [8월 30, 2016, 12:24오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/6 "2016-08-30T00:24:30Z")

</div>

> [@elijah](#):
>
> I suspect that is not true

I guess if your testing has proven the Postgres documentation is in need of correction. i.e.

> Aside from improving search quality, normalization and removal of stop words reduce the size of the tsvector representation of a document, thereby improving performance.

There is a link at the bottom of the page to a form where you should submit your findings so others can benefit from the improved knowledge.

> **[PostgreSQL:](https://www.postgresql.org/account/login/?next=%2Faccount%2Fcomments%2Fnew%2F9.1%2Ftextsearch-dictionaries.html%2F)**

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [8월 30, 2016, 12:28오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/7 "2016-08-30T00:28:36Z")

</div>

It is possible, however, it increases the bar significantly for performance issues:

> **[Stop Me If You Think You’ve Seen This Word Before](https://blog.codinghorror.com/stop-me-if-you-think-youve-seen-this-word-before/)**
>
> If you’ve ever searched for anything, you’ve probably run into stop words. Stop words are words so common they are typically ignored for search purposes. That is, if you type in a stop word as one of your search terms, the search engine will ignore...

Unlikely this is anything we would attack super soon. The answer is “use Google in these cases”. Have you tried that? Our 404 page includes a google search box as does the search help.

---

<div class="post-metadata">

### Author: ![elijah](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/elijah/32/104055_2.png) [@elijah](https://meta.discourse.org/u/elijah)
#### Post date: [8월 30, 2016, 12:32오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/8 "2016-08-30T00:32:11Z")

</div>

[https://meta.discourse.org/search?q=Now%20should%20I%20only%20do%20myself%3F%20No.%20We%20should%20both%20do%20ourselves%20](https://meta.discourse.org/search?q=Now%20should%20I%20only%20do%20myself%3F%20No.%20We%20should%20both%20do%20ourselves%20)

It’s not on the zero results search page. And the first words of the search help are “Title matches are prioritized – when in doubt, search for titles”.

I’m asking for title matches to get real priority.

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [8월 30, 2016, 1:30오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/9 "2016-08-30T01:30:36Z")

</div>

Feel free to submit pull requests. A Google search on the no search results page is a good idea.

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [8월 3, 2017, 12:03오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/10 "2017-08-03T00:03:25Z")

</div>

> [@codinghorror](#):
>
> A Google search on the no search results page is a good idea.

I want to revisit this and add it to someone’s list because I like it a lot. @neil can you take? Try to normalize the search code that’s on the “topic not found” page so we aren’t duplicating stuff everywhere, and bear in mind the public vs. private site caveats, we don’t want to show this on a private site..

---

<div class="post-metadata">

### Author: ![neil](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/neil/32/102150_2.png) [@neil](https://meta.discourse.org/u/neil)
#### Post date: [8월 14, 2017, 10:01오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/12 "2017-08-14T22:01:08Z")

</div>

I think the copy needs to be different here since it adds a second search field.

 ![21 PM](https://global.discourse-cdn.com/meta/original/3X/b/2/b2a9dc4c4bb8b9040945cac1416b3cd5a9bc7c46.png)

(and why is that New Topic button there?)

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [8월 15, 2017, 2:55오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/13 "2017-08-15T02:55:17Z")

</div>

The idea was

> Oh, I can’t find this, I should create a new topic since it doesn’t exist!

We should maybe move to a more conversational UI here like we do at the bottom of topics

> Want to read more? Browse other topics in #Contribute > Feature or view latest topics.

Such as

> Can’t find what you’re looking for? Start a new topic or use Google to search instead.

---

<div class="post-metadata">

### Author: ![tophee](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/tophee/32/73406_2.png) [@tophee](https://meta.discourse.org/u/tophee)
#### Post date: [8월 15, 2017, 5:39오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/14 "2017-08-15T05:39:58Z")

</div>

> [@codinghorror](#):
>
> Can’t find what you’re looking for? Start a new topic or use Google to search instead.

It would be nice if the domains to be searched by Google could be customized in site settings. That way, one could include a WordPress site, for example. Or was “search this site” already thought as including the entire domain, not just the forum’s sub-domain?

---

<div class="post-metadata">

### Author: ![neil](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/neil/32/102150_2.png) [@neil](https://meta.discourse.org/u/neil)
#### Post date: [8월 15, 2017, 6:04오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/15 "2017-08-15T18:04:54Z")

</div>

@codinghorror How about this? (Putting ember link-to’s inside translated strings is awkward)

 ![48 PM](https://global.discourse-cdn.com/meta/original/3X/1/b/1bdd9a419a247ccd0c37ebfb80ba3af172bf9b46.png)

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [8월 15, 2017, 6:32오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/16 "2017-08-15T18:32:12Z")

</div>

Looks good but delete the header above the search box.

---

<div class="post-metadata">

### Author: ![jomaxro](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/jomaxro/32/126216_2.png) [@jomaxro](https://meta.discourse.org/u/jomaxro)
#### Post date: [8월 15, 2017, 8:26오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/17 "2017-08-15T20:26:08Z")

</div>

Why remove the header? It is currently on the search page with or without results found, seems weird to remove it.

Existing no results page:

 ![image](https://global.discourse-cdn.com/meta/original/3X/8/3/831e8fcfe36db0f89a215ea34bc3d2878151e4e5.png)

Existing results found page:

 ![image](https://global.discourse-cdn.com/meta/original/3X/6/c/6c5810af4d639389f3626eff8b6417328ba2e9a9.png)

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [8월 15, 2017, 8:33오후 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/18 "2017-08-15T20:33:36Z")

</div>

I am referring to the header containing the words “Search this site”, in the prior screenshot. To be crystal clear:

 ![image](https://global.discourse-cdn.com/meta/original/3X/9/3/934e8c2a22f459d6ead4f070bd45e96f476db8ad.png)

Also minor point but @neil I think this reads better as

> Can’t find what you’re looking for? Start a new topic, or search with Google instead:

edit: I see the problem, search with google may not be available (private site) and creating a topic may not be available (you don’t have permissions) so these have to be two complete, independent sentences. OK, fine as is then @neil!

---

<div class="post-metadata">

### Author: ![codinghorror](https://sea3.discourse-cdn.com/meta/user_avatar/meta.discourse.org/codinghorror/32/110067_2.png) [@codinghorror](https://meta.discourse.org/u/codinghorror)
#### Post date: [8월 16, 2017, 12:31오전 UTC](https://meta.discourse.org/t/now-should-i-only-do-myself-no-we-should-both-do-ourselves/49417/19 "2017-08-16T00:31:10Z")

</div>

Also @elijah here’s the actual list of stopwords:

> <https://github.com/postgres/postgres/blob/master/src/backend/snowball/stopwords/english.stop>

So yeah the title is literally _all_ stopwords from this list, 👏
