No-break space and narrow no-break space are replaced by space

sam · November 15, 2021, 12:14am

It’s our text cleaner:

discourse/discourse/blob/2b848213f7dc6999ddf0809e68e1ceb980597c9d/lib/text_cleaner.rb#L74-L78

    
      
          @@whitespaces_regexp = Regexp.new("(\u00A0|\u1680|\u180E|[\u2000-\u200A]|\u2028|\u2029|\u202F|\u205F|\u3000)", "u").freeze
          
          
def self.normalize_whitespaces(text)
            text&.gsub(@@whitespaces_regexp, ' ')
          end

I think this was done to avoid a form of trivial griefing where people make edits to posts and they change nothing and people scratch head to say … what has changed?

Topic		Replies	Views
Consecutive spaces in inline code get collapsed ux markdown	12	426	March 9, 2023
Inconsistent internal onebox spacing ux	7	1128	May 13, 2022
Why does markdown do this? (whitespace trimming and other features) dev markdown	6	855	September 20, 2023
Khmer Unicode Zero Width Space disappears after posting bug	27	4357	March 29, 2015
Space before punctuation automatically removed in topic titles support	3	452	December 24, 2019

No-break space and narrow no-break space are replaced by space

Related Topics