URLs being dropped from Thunderbird-generated replies

Support
1

One of our team members who uses Thunderbird as their email client is finding that URLs they send to a Discourse topic in a reply mail results in the URLs being stripped from the message (i.e., the message is added to the topic, but any URLs in the message body have been removed when viewed on the Discourse site or in email notifications generated about the new message).

[edit: whitespace, like newlines, is being stripped as well, which I didn’t fully realize when making this original post or capturing the resulting output, which is updated below]

Some key lines from the Thunderbird-generated mail header are as follows (please let me know if there are others I should share):

User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0) Gecko/20100101 Thunderbird/68.12.0
Content-Type: text/plain; charset=utf-8; format=flowed

An example of such a message is:

https://github.com/chapel-lang/chapel/pull/16369 will make it only run under valgrind or with the address sanitizer.

Thanks,

Lydia

which shows up on Discourse as:

will make it only run under valgrind or with the address sanitizer. Thanks, Lydia

where the URL has disappeared, as have the newlines.

This behavior seems to be consistent whether the URL is the first non-whitespace content in the message body, or somewhere in the middle of the message.

Sending the identical message in other ways, particularly other plaintext ways, causes the URLs to be preserved:

  • from alpine (Content-Type: TEXT/PLAIN; format=flowed; charset=US-ASCII)
  • from gmail using “plain text” mode (Content-Type: text/plain; charset="UTF-8")
  • from OWA (Content-Type: text/html; charset="iso-8859-1")

Things we’ve tried to do to debug:

  • paste the Thunderbird-generated message with full header into the admin/email/advanced test tool, which seems to correctly identify the body of the message and preserve the URL
  • increasing the user’s trust level
  • have the user send the same message from the same Thunderbird session to other external mail recipients to make sure the URL was preserved

We’re looking for help determining what’s going wrong or what more we could do to debug the issue on our side. For example, is there any way for us (or for you) to view the raw received mail and/or to debug how it was processed beyond the “advanced test” tool?

Thanks very much for any help with this,
-Brad

1 Like
2

I happen to have Mozilla Thunderbird and I use it very frequently, so let me try reproducing the problem.

Actually, have you told your team member to update to the latest version of Mozilla Thunderbird? The latest stable (ESR) version is 78. That could possibly help.

1 Like
3

Thanks, Justin. I’ll see whether they’re able to update, though we’d definitely also be curious whether you can reproduce (with whatever version of Thunderbird) as well since that should hopefully be simple. I see the URL in the post you made here, but it looks like you made it via the web interface rather than via reply-by-mail?

Also, we’ve gathered more data since my original post:

  • When posting a new topic to a category’s email alias, the user’s URL’s are preserved
  • When surfing to the sent-mail folder and replying to one of their previous replies to a topic, the URL’s are preserved
  • When replying to a Discourse-generated email notification of a post to the topic, the URLs are stripped (also, the whitespace is stripped, which I hadn’t realized or captured correctly in my OP; I’ll edit it to clarify that).

So many cases work, but replies to notifications don’t seem to.

I’d be happy to point Discourse developers to the messages in question if that would help debug this.

4

Can you post the relevant sections of the raw email that Discourse received? Click on the :email: icon as an admin to pull that up.

Make sure to include both the HTML and plain parts.

1 Like
5

Thanks @riking, I hadn’t yet found that the envelope icon was a way to see the raw mail—great feature! (and I’m embarrassed not to have noticed it before)

Now that you’ve pointed that out to me, I’m finding that if I post the raw text into the “Advanced Test” tool, I see the result get similarly stripped, which is encouraging. It also looks like I was incorrect in thinking that the Thunderbird mail was raw text only (I came to that conclusion by having her send me the same mails directly and examining them, but must’ve drawn the wrong conclusions from that process?).

Now that I know about the envelope icon, I’ll try to compare the posts and replies that preserved URLs vs. those that didn’t to see if I can discern what the difference is between the cases.

Meanwhile, here’s the raw email in case you’re able to figure out what’s going wrong faster (let me know if this is not what you meant by “HTML and plain parts”):

Received: from mx0a-002e3701.pphosted.com (mx0a-002e3701.pphosted.com [148.163.147.86])
	by mail-receiver-stardestroyer02.localdomain (Postfix) with ESMTPS id 327765A0034
	for <[redacted]@discoursemail.com>; Thu, 10 Sep 2020 21:45:28 +0000 (UTC)
Received: from pps.filterd (m0150242.ppops.net [127.0.0.1])
	by mx0a-002e3701.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 08ALh9Yf003180
	for <[redacted]@discoursemail.com>; Thu, 10 Sep 2020 21:45:27 GMT
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hpe.com; h=subject : to :
 references : from : message-id : date : in-reply-to : content-type :
 mime-version; s=pps0720; bh=ChSY+1mRGWJd6n5TQD+D5xvMFvfxD5QrEr3giOJiDfk=;
 b=A8xOGxBBUZmqM/fZS8Gsb+y4b1aO8cAsp2/2YEtXX58XYDNfF4YSVrPB0eM10w20mJEk
 8haqYrpxNTdQkxy3jFhUyQDc6ZlQamd8KEt5YJdZ7MGLrMdG5R0I3g8LnslB2prRVU6z
 ig4gzp5rTYDxFcDV8s4ERPg4f+KTQ4iRQZLHXdqH9Jf4WKimLflzw8mDowhDld3lMfQd
 g6i35OegmS79DlnUcKGbiDDhpKfeNsoBXycsg/baZdZ9xlprCvbkqAyVI9dPk/SvnMkF
 Y739gvsJ3JMLuLEz7QuZN7AocDCyCymUvqL+Rwnxr/YlJuQDkfsOU8U6mZc2apI4QP9s Ig== 
Received: from [redacted].hpe.com ([redacted].hpe.com [15.241.140.75])
	by mx0a-002e3701.pphosted.com with ESMTP id 33ebqcpekj-1
	(version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT)
	for <[redacted]@discoursemail.com>; Thu, 10 Sep 2020 21:45:27 +0000
Received: from G9W8455.americas.hpqcorp.net (g9w8455.houston.hp.com [16.216.161.94])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits))
	(No client certificate requested)
	by [redacted].hpe.com (Postfix) with ESMTPS id D1F995C
	for <[redacted]@discoursemail.com>; Thu, 10 Sep 2020 21:45:26 +0000 (UTC)
Received: from G4W9120.americas.hpqcorp.net (2002:10d2:150f::10d2:150f) by
 G9W8455.americas.hpqcorp.net (2002:10d8:a15e::10d8:a15e) with Microsoft SMTP
 Server (TLS) id 15.0.1497.2; Thu, 10 Sep 2020 21:45:26 +0000
Received: from NAM12-BN8-obe.outbound.protection.outlook.com (15.241.52.12) by
 G4W9120.americas.hpqcorp.net (16.210.21.15) with Microsoft SMTP Server (TLS)
 id 15.0.1497.2 via Frontend Transport; Thu, 10 Sep 2020 21:45:26 +0000
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
 b=StYYs2rMEq8Pywiw5kjVmomgMJFIxfEo7sOSxU+shqgK7+CX6dMheZBVADDntjH8qHiLxsXbw2f2CazjLHvpocC4WNi+XK5n28+ypJL3/fPQW9b4yzbabPZqYgF9PEpDKfkj3VHmQI6F268e4cnV3m7CFTWU3LaHOn5Y1GJSxggkAh9FYJKKj45xHDFCD16I5eL4pcXKONWBrfxBqyzsUXqdVIWzGQ6AXRggnIaUpykxb2JfB0jEbzf9nL/sucw2w3rxFeks0jLiTXgWJehzXMz4+VGVIJ2ghLTdrdIj5DUuvO0cejDuA7E7jTUnIxToz+iFn8JDx9thz3VejwEYMA==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
 s=arcselector9901;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=2nbgvlig96DnvdgyjPro0TUYkJp1P0EaoU0n/Mnr7YI=;
 b=X1npZQ1RbGcZAWE5IKyQp6OfXQZS4wQfyP2cWwkQBoIlBxRirY4fO1MFq7Ih5FOUAGlCKcuw+uIkRzfrTd3ZLK7VBecFIvfwarZIz46kixzDHkhCuvIYQZFC6oowtz8JHgeUmXytz+GDv2t0foEPKyIDBnMdjY5fRntO9Ek6UrVjTpfJA5UcT2+AYj33Hj9jIu7r+twS1pZs9EWl6Uow8ALfHd2OAQvVikNiTKtmb2J/Y+u7+jfaW178HERPEoF+09wgh52UGFVmcwiZGGY3SiQ5+i5GOURFco7Ui0lqV4++7x07ggP63+nRts4t4LQgVql8Or/2CeeQ1NLEcC0wNg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
 smtp.mailfrom=hpe.com; dmarc=pass action=none header.from=hpe.com; dkim=pass
 header.d=hpe.com; arc=none
Authentication-Results: discoursemail.com; dkim=none (message not signed)
 header.d=none;discoursemail.com; dmarc=none action=none header.from=hpe.com;
Received: from DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
 (2a01:111:e400:7605::9) by DF4PR8401MB1178.NAMPRD84.PROD.OUTLOOK.COM
 (2a01:111:e400:7611::16) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16; Thu, 10 Sep
 2020 21:45:25 +0000
Received: from DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
 ([fe80::61cc:afd8:5ccf:8467]) by DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
 ([fe80::61cc:afd8:5ccf:8467%6]) with mapi id 15.20.3370.016; Thu, 10 Sep 2020
 21:45:25 +0000
Subject: Re: Cron fast
To: Chapel Programming Language
	<[redacted]@discoursemail.com>
References: <[redacted]@[redacted].cray.com>
 <[redacted]@hpe.com>
From: Lydia <[redacted]@hpe.com>
Message-ID: <[redacted]@hpe.com>
Date: Thu, 10 Sep 2020 14:45:22 -0700
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.14; rv:68.0)
 Gecko/20100101 Thunderbird/68.12.0
In-Reply-To: <[redacted]@hpe.com>
Content-Type: multipart/alternative;
 boundary="------------947BE6989DE4601A4B02D61A"
Content-Language: en-US
X-ClientProxiedBy: SA9PR03CA0013.namprd03.prod.outlook.com
 (2603:10b6:806:20::18) To DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
 (2a01:111:e400:7605::9)
X-MS-Exchange-MessageSentRepresentingType: 1
Received: from [IPv6:2601:602:9700:caf0:b907:fe19:a43e:bedd] (2601:602:9700:caf0:b907:fe19:a43e:bedd) by SA9PR03CA0013.namprd03.prod.outlook.com (2603:10b6:806:20::18) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16 via Frontend Transport; Thu, 10 Sep 2020 21:45:24 +0000
X-Originating-IP: [2601:602:9700:caf0:b907:fe19:a43e:bedd]
X-MS-PublicTrafficType: Email
X-MS-Office365-Filtering-HT: Tenant
X-MS-Office365-Filtering-Correlation-Id: adf0f211-a73d-4748-a8d4-08d855d2d352
X-MS-TrafficTypeDiagnostic: DF4PR8401MB1178:
X-Microsoft-Antispam-PRVS: <[redacted]@[redacted].COM>
X-MS-Oob-TLC-OOBClassifiers: OLM:229;
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info: WLWHXxywsaFi9Ug+cwRY7OyhpnL2dyt5npDFm9J0rlSp56m+bsFZoQ1AaiK4IYDkps843P81AeZK8fa5c+u+DEy+/r/TSd3XeEeLSoUdedidOK7zFPYZ66i9FlvzP2LvdNuOwI3BAqiJ8xHeK226EksZSZ08bFQIL2P30B9Ij/nClGKzAP8GFsyYCCF/tS2JlLl5NPuNObeNKGAK9EiMvJ9UWH+ZFSfUqmYTuCq0eWpoERzkLHRg8Ztebm286x5SnMSa2BH1SYq/j4yE4MIf+3filxIaiX0KJfVUiiw+oO0B52rYnNL7d0QKX2isX6iXGdTqT57LE0Ql3+UZtNN/GTCoUl7ZRKmTd4t5Snt+o2L0tKE4jTZIEIkfX3WnTHJg0CuJysy5txICmYlPvHgsCkk7uDcz+8pnDKHcHoQnEhSDh+2wosHpeF8Ti/C6kZ5OoaWTa1BnmhUg7H4iGb3Dyw==
X-Forefront-Antispam-Report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(396003)(39860400002)(376002)(346002)(136003)(366004)(19627405001)(83380400001)(3480700007)(52116002)(31686004)(186003)(6486002)(16526019)(166002)(8676002)(31696002)(44832011)(19627235002)(478600001)(5660300002)(86362001)(2616005)(8936002)(7116003)(66556008)(66476007)(316002)(36756003)(966005)(53546011)(2906002)(33964004)(66946007)(43740500002);DIR:OUT;SFP:1102;
X-MS-Exchange-AntiSpam-MessageData: b2MUeArmqQEr3/tncqFgZ3qliXiRB+U5kxO3yHLICwJb9XZ2vMTNPdzucK6Qtx1xBmcxFezNQSUduF5/g3OQvNqXDWklzCaNi5LVq5vD2Fev/Y//WjoiqCBrbgoQxB6UPvV4UDjB8DWx4XECPbHa75KJffblkadp7tTAjsT3MJzPHeFkSPPse2iVRxwl6l58TFre0CxAOWrAS21dgOWOTtY94gGY6C+3lSq1D0HX3lrWo64V6HgrIJnKzatpMN3eTpyCcj3+jDbCIb55dsoRBFmacHKJtywsvUSLd6ZctqvOUzzQHst0+o25+el+jJoHsMhhSuJsoLRKrZtdSswH0Ncbz7TJ87kLtu0UVMZTQd8qTRNq+s9Mq6Eks+LkNLaw6zrW9661QcRmlGhe1mFdMH9v4ETx/ePTJKMdYri2sMbEt0JES48FqmB7Xq4Dn1UyT7ohKKvX14iqnJ+MsR0FBqt1e3sRqzYjRmzsjmgxrBOZ7WPfdbFGR1GXOY1nFCL8GDqBE21R6kcG56X6nj4DnLeJnIjOW6B3I1IA6uOqIJBTUJbqDz1NCWC8XrqIhUmec+Fc2mOtnFbzBqeGB9307w6FaPqPcxwIJoLAWuiQxqlngl93maXzR6YrmG3QUNMEGhk0cqpirZwr8nJfe3FMXtR9xz4qjhCDv7Sqoy/26IcC3HTx3i5mKbe4NmU0EcgNaRXM0eausZIsBMQg04edDw==
X-MS-Exchange-CrossTenant-Network-Message-Id: adf0f211-a73d-4748-a8d4-08d855d2d352
X-MS-Exchange-CrossTenant-AuthSource: DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 10 Sep 2020 21:45:25.1767
 (UTC)
X-MS-Exchange-CrossTenant-FromEntityHeader: Hosted
X-MS-Exchange-CrossTenant-Id: 105b2061-b669-4b31-92ac-24d304d195dc
X-MS-Exchange-CrossTenant-MailboxType: HOSTED
X-MS-Exchange-CrossTenant-UserPrincipalName: lJKnu0aoPJ19uClKLOUJN1rcsjE3ofGcfjzhr2Mdqzc/n/5btMR0iUxbpu4j2RNpet1eXTDTeg0kLyT03M28BQ==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DF4PR8401MB1178
X-OriginatorOrg: hpe.com
X-Proofpoint-UnRewURL: 10 URL's were un-rewritten
MIME-Version: 1.0
X-HPE-SCL: -1
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.235,18.0.687
 definitions=2020-09-10_09:2020-09-10,2020-09-10 signatures=0
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 adultscore=0 clxscore=1011
 mlxscore=0 priorityscore=1501 malwarescore=0 mlxlogscore=999
 lowpriorityscore=0 bulkscore=0 suspectscore=2 impostorscore=0 phishscore=0
 spamscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2006250000 definitions=main-2009100188

--------------947BE6989DE4601A4B02D61A
Content-Type: text/plain; charset=utf-8; format=flowed
Content-Transfer-Encoding: 8bit

https://github.com/chapel-lang/chapel/pull/16369 will make it only run 
under valgrind or with the address sanitizer.

Thanks,
Lydia

On 9/10/20 10:28 AM, Michael Ferguson via Chapel Programming Language wrote:
> [mppf] 	mppf 
> <https://chapel.discourse.group/u/mppf> 
>
> September 10
>
> Hi Lydia-
>
> On my system, this test core dumps both before and after that PR.
> I think that this was a sporadic pass and that
> this test needs to run under valgrind in order to avoid that.
>
> -michael
>
> Hi Michael,
>
> |Would it make sense for your change to inout to have fixed this 
> future? I'm not sure there's a better candidate PR Thanks, Lydia|
> ------------------------------------------------------------------------
>
> Visit Topic 
> <https://chapel.discourse.group/t/cron-fast/485/3> 
> or reply to this email to respond.
>
> ------------------------------------------------------------------------
>
>
>         In Reply To
>
> [chapelu] 	chapelu 
> <https://chapel.discourse.group/u/chapelu> 
>
> September 10
>
> === Summary =================================================== 
> Hostname: chapvm12 Revision: 
> https://github.com/chapel-lang/chapel/commit/a07bdf4084 Logfile: 
> /data/sea/chapel/Nightly/day3-Wed-fast.log Started: Wed Sep 9 02:00:21 
> 2020 Ended: Wed Sep 9 23:52:03 2020 Tests run: View this …
> ------------------------------------------------------------------------
>
> Visit Topic 
> <https://chapel.discourse.group/t/cron-fast/485/3> 
> or reply to this email to respond.
>
> You are receiving this because you enabled mailing list mode.
>
> To unsubscribe from these emails, click here 
> <https://chapel.discourse.group/email/unsubscribe/77f8d8547c5965131c2906502bcbfa7f23366cb5414372e803368a6fe5e814de>.
>


--------------947BE6989DE4601A4B02D61A
Content-Type: text/html; charset=utf-8
Content-Transfer-Encoding: 8bit

<html><head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body>
    <a class="moz-txt-link-freetext" href="https://github.com/chapel-lang/chapel/pull/16369">https://github.com/chapel-lang/chapel/pull/16369</a> will make it only
    run under valgrind or with the address sanitizer.<br>
    <br>
    Thanks,<br>
    Lydia<br>
    <br>
    <div class="moz-cite-prefix">On 9/10/20 10:28 AM, Michael Ferguson
      via Chapel Programming Language wrote:<br>
    </div>
    <blockquote type="cite" cite="mid:[redacted]@hpe.com">
      
      <!-- prevent ios zooming + autoscaling -->
      <meta name="x-apple-disable-message-reformatting">
      <title></title>
      <!--[if mso]>
<style type="text/css">
body, table, td, th, h1, h2, h3 {font-family: Helvetica, Arial, sans-serif !important;}
</style>
<![endif]-->
      <div>
        <div style="margin-bottom:25px;">
          <table cellspacing="0" cellpadding="0" border="0">
            <tbody>
              <tr>
                <td style="vertical-align:top;width:55px;"> <img src="https://avatars.discourse-cdn.com/v4/letter/m/94ad74/45.png" title="mppf" moz-do-not-send="true" width="45" height="45"> </td>
                <td> <a href="https://chapel.discourse.group/u/mppf" target="_blank" style="color:#006699;;
                    font-size:13px;font-family:'lucida
grande',tahoma,verdana,arial,sans-serif;text-decoration:none;font-weight:bold;
                    text-decoration: none; font-weight: bold; color:
                    #006699;" moz-do-not-send="true">mppf</a> <br>
                  <span style="text-align:right;color:#999999;padding-right:5px;font-family:'lucida
grande',tahoma,verdana,arial,sans-serif;font-size:11px">September 10</span>
                </td>
              </tr>
            </tbody>
          </table>
          <div style="padding-top:5px;">
            <p style="margin-top:0; border: 0;">Hi Lydia-</p>
            <p style="margin-top:0; border: 0;">On my system, this test
              core dumps both before and after that PR.<br>
              I think that this was a sporadic pass and that<br>
              this test needs to run under valgrind in order to avoid
              that.</p>
            <p style="margin-top:0; border: 0;">-michael</p>
            <p style="margin-top:0; border: 0;">Hi Michael,</p>
            <pre style="word-wrap: break-word; max-width: 694px;"><code style="display: block; background-color: #f1f1ff; padding: 5px;; background-color: #f1f1ff; padding: 2px 5px;">Would it make sense for your change to inout to have fixed this future?  I'm not sure there's a better candidate PR

Thanks,
Lydia</code></pre>
          </div>
        </div>
        <div style="color:#666;">
          <hr style="background-color: #ddd; height: 1px; border: 1px;;
            background-color: #ddd; height: 1px; border: 1px;">
          <p><a href="https://chapel.discourse.group/t/cron-fast/485/3" style="text-decoration: none; font-weight: bold; color:
              #006699;; color:#666;" moz-do-not-send="true">Visit Topic</a>
            or reply to this email to respond.</p>
        </div>
        <hr style="background-color: #ddd; height: 1px; border: 1px;;
          background-color: #ddd; height: 1px; border: 1px;">
        <h4 style="font-size: 17px; color: #444; margin-bottom:10px;;
          color: #222;">In Reply To</h4>
        <div style="margin-bottom:25px;">
          <table cellspacing="0" cellpadding="0" border="0">
            <tbody>
              <tr>
                <td style="vertical-align:top;width:55px;"> <img src="https://sjc2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/chapelu/45/23_2.png" title="chapelu" moz-do-not-send="true" width="45" height="45"> </td>
                <td> <a href="https://chapel.discourse.group/u/chapelu" target="_blank" style="color:#006699;;
                    font-size:13px;font-family:'lucida
grande',tahoma,verdana,arial,sans-serif;text-decoration:none;font-weight:bold;
                    text-decoration: none; font-weight: bold; color:
                    #006699;" moz-do-not-send="true">chapelu</a> <br>
                  <span style="text-align:right;color:#999999;padding-right:5px;font-family:'lucida
grande',tahoma,verdana,arial,sans-serif;font-size:11px">September 10</span>
                </td>
              </tr>
            </tbody>
          </table>
          <div style="padding-top:5px;">=== Summary
            ===================================================
            Hostname: chapvm12 Revision: <a href="https://github.com/chapel-lang/chapel/commit/a07bdf4084" style="text-decoration: none; font-weight: bold; color:
              #006699;" moz-do-not-send="true">https://github.com/chapel-lang/chapel/commit/a07bdf4084</a>
            Logfile: /data/sea/chapel/Nightly/day3-Wed-fast.log Started:
            Wed Sep 9 02:00:21 2020 Ended: Wed Sep 9 23:52:03 2020 Tests
            run: View this …</div>
        </div>
        <div style="color:#666;">
          <hr style="background-color: #ddd; height: 1px; border: 1px;;
            background-color: #ddd; height: 1px; border: 1px;">
          <p><a href="https://chapel.discourse.group/t/cron-fast/485/3" style="font-weight: normal;; text-decoration: none;
              font-weight: bold; color: #006699;; background-color:
              #2F70AC; color: #FFFFFF; border-top: 4px solid #2F70AC;
              border-right: 6px solid #2F70AC; border-bottom: 4px solid
              #2F70AC; border-left: 6px solid #2F70AC; display:
              inline-block; font-weight: bold;" moz-do-not-send="true">Visit
              Topic</a> or reply to this email to respond.</p>
        </div>
        <div style="color:#666;">
          <p>You are receiving this because you enabled mailing list
            mode.</p>
          <p>To unsubscribe from these emails, <a href="https://chapel.discourse.group/email/unsubscribe/77f8d8547c5965131c2906502bcbfa7f23366cb5414372e803368a6fe5e814de" style="text-decoration: none; font-weight: bold; color:
              #006699;; color:#666;" moz-do-not-send="true">click here</a>.</p>
        </div>
      </div>
      <div itemscope="" itemtype="http://schema.org/EmailMessage" style="display:none">
        <div itemprop="action" itemscope="" itemtype="http://schema.org/ViewAction">
          <link itemprop="url" href="https://chapel.discourse.group/t/cron-fast/485/3">
          <meta itemprop="name" content="Read full topic">
        </div>
      </div>
      <!-- prevent Gmail on iOS font size manipulation -->
      <div style="display:none;white-space:nowrap;font:15px
        courier;line-height:0">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;
        &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</div>
    </blockquote>
    <br>
  </body>
</html>

--------------947BE6989DE4601A4B02D61A--
6

The interesting part being:

    <a class="moz-txt-link-freetext" href="https://github.com/chapel-lang/chapel/pull/16369">https://github.com/chapel-lang/chapel/pull/16369</a> will make it only
    run under valgrind or with the address sanitizer.<br>
    <br>
    Thanks,<br>
    Lydia<br>
    <br>
1 Like
7

Right. And it definitely seems to be that HTML version that’s making it through to the post (rather than the text version of the message), as determined by editing each versoin of the message in the “Advanced Test” tool. So it seems that the tool strips all the HTML from this mail (which also explains the linefeeds going away), but doesn’t in the OWA version of the message, which is also multipart. I’m currently comparing the two messages to try and determine why that is.

Here’s an OWA version of the message that preserves the link and whitespace, for comparison:

Received: from mx0a-002e3701.pphosted.com (mx0a-002e3701.pphosted.com [148.163.147.86])
	by mail-receiver-stardestroyer01.localdomain (Postfix) with ESMTPS id D60773809F3
	for <[redacted]@discoursemail.com>; Thu, 10 Sep 2020 22:23:11 +0000 (UTC)
Received: from pps.filterd (m0148663.ppops.net [127.0.0.1])
	by mx0a-002e3701.pphosted.com (8.16.0.42/8.16.0.42) with SMTP id 08AMNBwC018361
	for <[redacted]@discoursemail.com>; Thu, 10 Sep 2020 22:23:11 GMT
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=hpe.com; h=from : to : subject :
 date : message-id : references : in-reply-to : content-type :
 mime-version; s=pps0720; bh=9faio6NPsfwH6BtbWP4x92WGx5oR9wUVRQE13eh76rI=;
 b=AbxnhW04r7rkESlmg3nA/9AvL1kOzpQDuO7qS1QHjyY2Y/DFDIu7lYrELcf4uWEYqLlN
 GyD8PXY2BW3w1owPt8vJkkGsdhW4Dg/50E6O2q8xmm6oWQRG6Gsfe2m85qcE7dRG3nh2
 XHfmQWUYwYpiLnQEEXt1Ze85nKtuIeaS7NjwmStv5FSP67YSq8nbVjsUo04ZcLFuQCCN
 0lW+1YX0RYFN0qQ5+INk6D6amQj0q84uhifkgPs8VSpf3+YG+q6tZu8WpCebU24UpG84
 tIFEkTZaPc11RwuKqTxUF+2hdbsRrKm3tpOk9qXBGxPjr7USNCWfXImLBIpCOWIKQIQw dw== 
Received: from [redacted].hpe.com ([redacted].hpe.com [15.241.48.73])
	by mx0a-002e3701.pphosted.com with ESMTP id 33ffbqptwe-1
	(version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384 bits=256 verify=NOT)
	for <[redacted]@discoursemail.com>; Thu, 10 Sep 2020 22:23:11 +0000
Received: from G2W6310.americas.hpqcorp.net (g2w6310.austin.hp.com [16.197.64.52])
	(using TLSv1.2 with cipher ECDHE-RSA-AES256-SHA384 (256/256 bits))
	(No client certificate requested)
	by [redacted].hpe.com (Postfix) with ESMTPS id BF48D6A
	for <[redacted]@discoursemail.com>; Thu, 10 Sep 2020 22:22:49 +0000 (UTC)
Received: from G4W9121.americas.hpqcorp.net (2002:10d2:1510::10d2:1510) by
 G2W6310.americas.hpqcorp.net (2002:10c5:4034::10c5:4034) with Microsoft SMTP
 Server (TLS) id 15.0.1497.2; Thu, 10 Sep 2020 22:22:49 +0000
Received: from NAM11-BN8-obe.outbound.protection.outlook.com (15.241.52.10) by
 G4W9121.americas.hpqcorp.net (16.210.21.16) with Microsoft SMTP Server (TLS)
 id 15.0.1497.2 via Frontend Transport; Thu, 10 Sep 2020 22:22:49 +0000
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
 b=Wf8Y4Wifgp5AMKhWcjY4WKtWOVf9dQ7RPOZgob+Epy6xFV8fGO8LB+OCUzor3+I9mAPHyfjN9k78C6HyF/Kpo2/UIvotZB+C/jLch4rpX50m+kj5O8m37y4upVm8yYQ1W0/OXYGeR4xpMDvZPzG6mQWBSzSo7HJiVCNaIh1qTM4OnAQV3erj2arZ8g0xrg+Vh59tgs6R3kJEfbZ74PYMZC34oHOlkAFQBLbpAKqz8rcPu14iu99N04/YFXILgyrfyYdAcSgpfRG+p48+2hyHAIQ4jKA+pAAzA9odsExQFvOFJFuWsaar/qw20z+SW0vwktqWXTny8UUKSpKs7DIK4w==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
 s=arcselector9901;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=YGHLlEFuu+TH3S22Jqp0UCQ/leI0Iaa3QV/zV4U0l6U=;
 b=gIql7fbTocRo2RBp/fReKXPKtU75f4e49LYuEZBRb3aX35DMz7eOwFvYM4Oqm5E9AU51J2D+NnyM1NVGpfSiZ61gB+F+ejvFzXp/rr6ZUZGA66crPQbLEJmEImKEBZfOFsT46JCP5LeF/xQKAf09BmYehSOsGkL9AmocysGJI3u7KTPqwkGEBE/PPCraC4PKJMClguYj+0cVWOq9HCOrpOguy9FJZa2vxtnWwjtlcOo0fvMkM31IRKm8CT0Fj5PxXNuvkcEOe0NZ3KE2FDzT8sbEBRD1VV4s78yh++pcPOjbMmj6O5W7FCapA4MZR/Um3MT1Bzt7tTXOEPRMjdGWDw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
 smtp.mailfrom=hpe.com; dmarc=pass action=none header.from=hpe.com; dkim=pass
 header.d=hpe.com; arc=none
Received: from DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
 (2a01:111:e400:7605::9) by DF4PR8401MB0937.NAMPRD84.PROD.OUTLOOK.COM
 (2a01:111:e400:7606::21) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.3370.16; Thu, 10 Sep
 2020 22:22:48 +0000
Received: from DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
 ([fe80::61cc:afd8:5ccf:8467]) by DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
 ([fe80::61cc:afd8:5ccf:8467%6]) with mapi id 15.20.3370.016; Thu, 10 Sep 2020
 22:22:48 +0000
From: "Lydia" <[redacted]@hpe.com>
To: Chapel Programming Language
	<[redacted]@discoursemail.com>
Subject: Re: Cron fast
Thread-Topic: Cron fast
Thread-Index: AQHWhy+SmUyk0ZWum066c4vdm23Zsalh/E6AgAAiA4D//9+rhQ==
Date: Thu, 10 Sep 2020 22:22:48 +0000
Message-ID: <[redacted]@DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM>
References: <[redacted]@cfexhybrid.americas.cray.com>,<[redacted]@hpe.com>
In-Reply-To: <[redacted]@hpe.com>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach: 
X-MS-TNEF-Correlator: 
authentication-results: discoursemail.com; dkim=none (message not signed)
 header.d=none;discoursemail.com; dmarc=none action=none header.from=hpe.com;
x-originating-ip: [24.22.134.40]
x-ms-publictraffictype: Email
x-ms-office365-filtering-ht: Tenant
x-ms-office365-filtering-correlation-id: 6dcdeec3-d941-4b6f-2237-08d855d80c58
x-ms-traffictypediagnostic: DF4PR8401MB0937:
x-microsoft-antispam-prvs: <[redacted]@[redacted].COM>
x-ms-oob-tlc-oobclassifiers: OLM:279;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: QHAkmgMhy6+H4z9tNR3Z3KjaSqZlJR4EBL8MVBk/aWBaKHQcoHhrokPuznrPOGM/U8xGFgeFt/YFztfHqR0vjafjnen3gP+ymkrvc9b7CoRcoRux0BvCSgZt5lAsXfjfU+Ng5YkkBcWHNhLxmnjyhjYn7gx/OUPvxWjk4QUgzIAOlWsJBAVQkvTot1uLufTZ39lOEbn0c1pAbJ9EejAET6dM2XTjsGRjzub9rcpv7wKo7nBpenb42ltlLn5bUxD4yTlGTS28KXHoQaRYgfD5jdD/XLelw85t167DyEEPIoKrIhtmV0oHJkHFyzXntXqHN3QxSAnZCe2hUmo6xuXWqZXfqxYl/qA12ShkdnIG4M8p/QHBFyvc6z2pykQ07rUncCEC1lq04fvxkwm5RZr2yw==
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM;PTR:;CAT:NONE;SFS:(39860400002)(366004)(136003)(396003)(346002)(376002)(6506007)(3480700007)(166002)(86362001)(8936002)(53546011)(33656002)(76116006)(2906002)(478600001)(45080400002)(66946007)(186003)(66556008)(64756008)(26005)(66446008)(66476007)(19627235002)(966005)(19627405001)(9686003)(83380400001)(8676002)(316002)(52536014)(71200400001)(5660300002)(7116003)(55016002)(7696005);DIR:OUT;SFP:1102;
x-ms-exchange-antispam-messagedata: xFMoMYd51YW28PMywZGtascu04MXshEngNFriWmiRtQsUxey5KaeTUXgpdN2YYoBLBOck2Fc01xdbiX8vdJrwEsROz07CI11MF1lO3fCWYRLr2cG19TwUSVw6seQuPqNEK88CdZT2N+gmkqSzrDCmoes5SvoElmNjXZXfnZEo4RBdDBICe685IaK+JdL1nnyrhcgGALxFLzt3CGdh4nsOrm1IexyxduJCg0ju9bD7gQ1QEqrGX0eqivMCfJITXJVHHIyUiEx3XcY9bdVbUqqvQCGsoR4R3+w/tFXE+B2dfPa2iPCvu179Jq4RCCtbqG6a+nJ3EBIf0h7qKQMNeY3DiyjKp+buGeHIg6kdBQIgi46RTS1Ge2Bv3IZt73Yu8lK7ABBuBA3O4v7RcnOKJ2iKQJX3ihEUdeeUt+sZr4vovXtM1RQR88w3YlVg7nYRJMWzMeYNwF56D0PwjDDohpRt3oOklGcv2YL00ScjlNilwIE38y35ffdIipk/gWzNvL5fiuD84tEWxYlACX3Sf0u2b0DKA7t+Kei1ChnUC+XD8QA6TCqdejql1fgITgJVzD7rthU/IPN9VbvBUPeyTB0D+VYwkRi0WQ4BfNeXltHQCw9Fgv7ZoXkiqHsNrysjssm31wPvOa3XJY/WrZjOVybyQ==
x-ms-exchange-transport-forked: True
Content-Type: multipart/alternative;
	boundary="_000_DF4PR8401MB0410D2608868CB53F793BE6F8C270DF4PR8401MB0410_"
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: DF4PR8401MB0410.NAMPRD84.PROD.OUTLOOK.COM
X-MS-Exchange-CrossTenant-Network-Message-Id: 6dcdeec3-d941-4b6f-2237-08d855d80c58
X-MS-Exchange-CrossTenant-originalarrivaltime: 10 Sep 2020 22:22:48.0494
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 105b2061-b669-4b31-92ac-24d304d195dc
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: 7EBFkxT7R923thf/Ae+zxbs40cL260RQUSHr2Nm+3Ez1Jb4FZr00jKUf2f07/Am0scOX3jw79z4OMwjvvfmEyA==
X-MS-Exchange-Transport-CrossTenantHeadersStamped: DF4PR8401MB0937
X-OriginatorOrg: hpe.com
X-Proofpoint-UnRewURL: 10 URL's were un-rewritten
MIME-Version: 1.0
X-HPE-SCL: -1
X-Proofpoint-Virus-Version: vendor=fsecure engine=2.50.10434:6.0.235,18.0.687
 definitions=2020-09-10_10:2020-09-10,2020-09-10 signatures=0
X-Proofpoint-Spam-Details: rule=outbound_notspam policy=outbound score=0 lowpriorityscore=0
 malwarescore=0 mlxlogscore=882 priorityscore=1501 mlxscore=0
 suspectscore=0 bulkscore=0 impostorscore=0 clxscore=1015 adultscore=0
 spamscore=0 phishscore=0 classifier=spam adjust=0 reason=mlx scancount=1
 engine=8.12.0-2006250000 definitions=main-2009100194

--_000_DF4PR8401MB0410D2608868CB53F793BE6F8C270DF4PR8401MB0410_
Content-Type: text/plain; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable

https://github.com/chapel-lang/chapel/pull/16369 will make it only run
under valgrind or with the address sanitizer.


Thanks,
Lydia

(Trying with outlook instead of Thunderbird in case that does anything)
________________________________
From: Michael via Chapel Programming Language <[redacted]@discoursemai=
l.com>
Sent: Thursday, September 10, 2020 10:28 AM
To: Lydia <[redacted]@hpe.com>
Subject: Re: Cron fast

[https://avatars.discourse-cdn.com/v4/letter/m/94ad74/45.png]   mppf<https:=
//chapel.discourse.group/u/mppf>
September 10

Hi Lydia-

On my system, this test core dumps both before and after that PR.
I think that this was a sporadic pass and that
this test needs to run under valgrind in order to avoid that.

-michael

Hi Michael,

Would it make sense for your change to inout to have fixed this future?  I'=
m not sure there's a better candidate PR

Thanks,
Lydia

________________________________

Visit Topic<https://chapel.discourse.group/t/cron-fast/485/3> or reply to t=
his email to respond.

________________________________
In Reply To
[https://sjc2.discourse-cdn.com/free1/user_avatar/chapel.discourse.group/ch=
apelu/45/23_2.png]   chapelu<https://chapel.discourse.group/u/chapelu>
September 10
=3D=3D=3D Summary =3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D Hostname: chapvm12 Revision: https://github.com/chape=
l-lang/chapel/commit/a07bdf4084 Logfile: /data/sea/chapel/Nightly/day3-Wed-=
fast.log Started: Wed Sep 9 02:00:21 2020 Ended: Wed Sep 9 23:52:03 2020 Te=
sts run: View this =85
________________________________

Visit Topic<https://chapel.discourse.group/t/cron-fast/485/3> or reply to t=
his email to respond.

You are receiving this because you enabled mailing list mode.

To unsubscribe from these emails, click here<https://chapel.discourse.group=
/email/unsubscribe/77f8d8547c5965131c2906502bcbfa7f23366cb5414372e803368a6f=
e5e814de>.



--_000_DF4PR8401MB0410D2608868CB53F793BE6F8C270DF4PR8401MB0410_
Content-Type: text/html; charset="Windows-1252"
Content-Transfer-Encoding: quoted-printable

<html>
<head>
<meta http-equiv=3D"Content-Type" content=3D"text/html; charset=3DWindows-1=
252">
<style type=3D"text/css" style=3D"display:none;"> P {margin-top:0;margin-bo=
ttom:0;} </style>
</head>
<body dir=3D"ltr">
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0);">
<p style=3D"margin-top:0; border: 0"><a href=3D"https://github.com/chapel-l=
ang/chapel/pull/16369" style=3D"font-weight: bold; color: #006699">https://=
github.com/chapel-lang/chapel/pull/16369</a> will make it only run<br>
under valgrind or with the address sanitizer.</p>
<p style=3D"margin-top:0; border: 0"><br>
</p>
<p style=3D"margin-top:0; border: 0">Thanks,<br>
Lydia</p>
</div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0);">
<br>
</div>
<div style=3D"font-family: Calibri, Arial, Helvetica, sans-serif; font-size=
: 12pt; color: rgb(0, 0, 0);">
(Trying with outlook instead of Thunderbird in case that does anything)<br>
</div>
<div id=3D"appendonsend"></div>
<hr style=3D"display:inline-block;width:98%" tabindex=3D"-1">
<div id=3D"divRplyFwdMsg" dir=3D"ltr"><font face=3D"Calibri, sans-serif" st=
yle=3D"font-size:11pt" color=3D"#000000"><b>From:</b> Michael Ferguson via =
Chapel Programming Language &lt;[redacted]@discoursemail.com&gt;<br>
<b>Sent:</b> Thursday, September 10, 2020 10:28 AM<br>
<b>To:</b>Lydia &lt;[redacted]@hpe.com&gt;<br>
<b>Subject:</b> Re: Cron fast</font>
<div>&nbsp;</div>
</div>
<div dir=3D"ltr" style=3D"text-align:left">
<div>
<div></div>
<div style=3D"margin-bottom:25px">
<table cellspacing=3D"0" cellpadding=3D"0" border=3D"0">
<tbody>
<tr>
<td style=3D"vertical-align:top; width:55px"><img title=3D"mppf" width=3D"4=
5" height=3D"45" src=3D"https://avatars.discourse-cdn.com/v4/letter/m/94ad7=
4/45.png">
</td>
<td><a href=3D"https://chapel.discourse.group/u/mppf" target=3D"_blank" sty=
le=3D"color:#006699; font-size:13px; font-family:'lucida grande',tahoma,ver=
dana,arial,sans-serif; text-decoration:none; font-weight:bold; text-decorat=
ion:none; font-weight:bold; color:#006699">mppf</a>
<br>
<span style=3D"text-align:right; color:#999999; padding-right:5px; font-fam=
ily:'lucida grande',tahoma,verdana,arial,sans-serif; font-size:11px">Septem=
ber 10</span>
</td>
</tr>
</tbody>
</table>
<div style=3D"padding-top:5px">
<p style=3D"margin-top:0; border:0">Hi Lydia-</p>
<p style=3D"margin-top:0; border:0">On my system, this test core dumps both=
 before and after that PR.<br>
I think that this was a sporadic pass and that<br>
this test needs to run under valgrind in order to avoid that.</p>
<p style=3D"margin-top:0; border:0">-michael</p>
<p style=3D"margin-top:0; border:0">Hi Michael,</p>
<pre style=3D"word-wrap:break-word; max-width:694px"><code style=3D"display=
:block; background-color:#f1f1ff; padding:5px; background-color:#f1f1ff; pa=
dding:2px 5px">Would it make sense for your change to inout to have fixed t=
his future?  I'm not sure there's a better candidate PR

Thanks,
Lydia</code></pre>
</div>
</div>
<div style=3D"color:#666">
<hr style=3D"background-color:#ddd; height:1px; border:1px; background-colo=
r:#ddd; height:1px; border:1px">
<p><a href=3D"https://chapel.discourse.group/t/cron-fast/485/3" style=3D"te=
xt-decoration:none; font-weight:bold; color:#006699; color:#666">Visit
 Topic</a> or reply to this email to respond.</p>
</div>
<hr style=3D"background-color:#ddd; height:1px; border:1px; background-colo=
r:#ddd; height:1px; border:1px">
<h4 style=3D"font-size:17px; color:#444; margin-bottom:10px; color:#222">In=
 Reply To</h4>
<div style=3D"margin-bottom:25px">
<table cellspacing=3D"0" cellpadding=3D"0" border=3D"0">
<tbody>
<tr>
<td style=3D"vertical-align:top; width:55px"><img title=3D"chapelu" width=
=3D"45" height=3D"45" src=3D"https://sjc2.discourse-cdn.com/free1/user_avat=
ar/chapel.discourse.group/chapelu/45/23_2.png">
</td>
<td><a href=3D"https://chapel.discourse.group/u/chapelu" target=3D"_blank" =
style=3D"color:#006699; font-size:13px; font-family:'lucida grande',tahoma,=
verdana,arial,sans-serif; text-decoration:none; font-weight:bold; text-deco=
ration:none; font-weight:bold; color:#006699">chapelu</a>
<br>
<span style=3D"text-align:right; color:#999999; padding-right:5px; font-fam=
ily:'lucida grande',tahoma,verdana,arial,sans-serif; font-size:11px">Septem=
ber 10</span>
</td>
</tr>
</tbody>
</table>
<div style=3D"padding-top:5px">=3D=3D=3D Summary =3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=
=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D=3D Hostname: chapvm12 R=
evision:
<a href=3D"https://github.com/chapel-lang/chapel/commit/a07bdf4084" style=
=3D"text-decoration:none; font-weight:bold; color:#006699">
https://github.com/chapel-lang/chapel/commit/a07bdf4084</a> Logfile: /data/=
sea/chapel/Nightly/day3-Wed-fast.log Started: Wed Sep 9 02:00:21 2020 Ended=
: Wed Sep 9 23:52:03 2020 Tests run: View this =85</div>
</div>
<div style=3D"color:#666">
<hr style=3D"background-color:#ddd; height:1px; border:1px; background-colo=
r:#ddd; height:1px; border:1px">
<p><a href=3D"https://chapel.discourse.group/t/cron-fast/485/3" style=3D"fo=
nt-weight:normal; text-decoration:none; font-weight:bold; color:#006699; ba=
ckground-color:#2F70AC; color:#FFFFFF; border-top:4px solid #2F70AC; border=
-right:6px solid #2F70AC; border-bottom:4px solid #2F70AC; border-left:6px =
solid #2F70AC; display:inline-block; font-weight:bold">Visit
 Topic</a> or reply to this email to respond.</p>
</div>
<div style=3D"color:#666">
<p>You are receiving this because you enabled mailing list mode.</p>
<p>To unsubscribe from these emails, <a href=3D"https://chapel.discourse.gr=
oup/email/unsubscribe/77f8d8547c5965131c2906502bcbfa7f23366cb5414372e803368=
a6fe5e814de" style=3D"text-decoration:none; font-weight:bold; color:#006699=
; color:#666">
click here</a>.</p>
</div>
</div>
<div itemscope=3D"" itemtype=3D"http://schema.org/EmailMessage" style=3D"di=
splay:none">
<div itemprop=3D"action" itemscope=3D"" itemtype=3D"http://schema.org/ViewA=
ction"><link itemprop=3D"url" href=3D"https://chapel.discourse.group/t/cron=
-fast/485/3">
<meta itemprop=3D"name" content=3D"Read full topic">
</div>
</div>
<div style=3D"display:none; white-space:nowrap; font:15px courier; line-hei=
ght:0">&nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp=
; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nb=
sp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp; &nbsp;</div>
</div>
</body>
</html>

--_000_DF4PR8401MB0410D2608868CB53F793BE6F8C270DF4PR8401MB0410_--
8

Oh, interesting. All it takes for me to change the broken version in this message to a working version in the “Advanced Test” tool is to remove class="moz-txt-link-freetext" from the <a href> link… Is that surprising?

1 Like
9

To be make my previous question a bit more precise, is it a bug on Thunderbird’s part that it puts class="moz-txt-link-freetext into hyperlinks in emails that it sends? Is it a bug on Discourse’s part that the presence of such a tag causes the <a>...</a>-enclosed URL to be dropped from the body of the message and subsequent <br> tags to be ignored?

1 Like
10

Hi @Falco and @riking — Sorry to bug you, but since you’d looked at this issue previously: do you have any thoughts on my questions in the previous post about whether this is buggy behavior on the part of Thunderbird and/or Discourse? Thanks.

13

Hi @BradCray ,
I’ve experienced this same problem too when using import_mbox.sh on mailman mbox archives.

I tracked the problem down to extract_from_mozilla(doc) in lib/email/receiver.rb and made a simple fix which I’ve put in a PR https://github.com/discourse/discourse/pull/13176 .

The extract_from_mozilla method was making any tag with a class attribute starting with "moz-" hidden. My adjustment excludes from these hidden tags any of them with a class attribute starting with ^moz-txt-link\b which I think covers Thunderbird’s links (based on the large mbox I was working with).

I haven’t had time to write tests so the PR might not get accepted but feel free to use it (although be aware it’ll probably be wiped out by any upgrade unless the PR is accepted).

I’ve only tested on imported mboxes but I think it should work on newly received email.
Unfortunately I don’t think it will apply during a rebake (it didn’t for me) so might be pretty hard to apply retrospectively.

4 Likes
14

@BradCray, for info the PR won’t be accepted without tests and it’ll be some time before I get a change to look into doing that.

15

Thanks for the attempt at fixing this and update, @bsoares! Maybe your PR will inspire someone else who’s already familiar with discourse testing to pick up the testing aspect if you can’t get to it sooner (?). I tend to be a little surprised that this issue hasn’t generated more interest or concern, as my impression is that Thunderbird is a reasonably popular email client (though admittedly, I don’t use it myself).

Thanks again,
-Brad

17

Thanks for the comments @BradCray . Hopefully I’ll find time – work has said I can spend some time on it but it probably won’t be for a couple of weeks at least. I’m also surprised there isn’t more mention of this, as you say Thunderbird is a popular email client. We’re just switching to discourse and I’ve been playing with importing mailman mboxes, my colleague noticed the problem more or less straight away! Took a bit to diagnose because there’s nothing wrong with the Thunderbird emails, just an overzealous sig/reply hider in lib/email/receiver.rb!

1 Like
18

@BradCray (and anyone else after a fix for this), I’m not going to have time to get a proper PR with tests any time soon, so what I have put in place for out discourse is a patch which should continue to work so long as the method in question doesn’t get changed (in which case I hope it gets fixed!).

Put the attached lib_email_receiver_rb-thunderbird_links.patch in, say /var/discourse/shared/standalone/patches.txt [lib_email_receiver_rb-thunderbird_links.patch.txt|attachment](upload://1OvwVDGUCO2Y3VtkGZnt6hCjAZk.txt) (819 Bytes) (you might have to

mkdir -p  /var/discourse/shared/standalone/patches

)
and then put the following in containers/app.yml in the hooks: after_code: section (after the plugins if you have any):

hooks:
  after_code:
    # plugins "-exec" here
    - exec:
        cd: $home
        cmd:
          - git apply /shared/patches/lib_email_receiver_rb-thunderbird_links.patch.txt

This assumes you have /var/discourse/shared/standalone mapped to /shared in the volumes: section, so adjust to suit your environment.

You’ll need to rebuild the container with ./launcher rebuild app but you should retain the fix whenever you rebuild. Not sure if a web-admin induced update would apply it though.

[The attachment has extension .txt so it can be attached to this comment, you may want to get rid of it in the filename and the config]

1 Like
19

I have the problem too. Therefore I would like to try the solution/workaround with the patch file. Unfortunately, the attachment lib_email_receiver_rb-thunderbird_links.patch was not uploaded correctly. Could you please resend it? Maybe simply as a code block?

4 Likes
20

Hi, I’ve attached the file again (with a ‘.txt’ added for upload reasons), and here’s the content anyway:

diff --git a/lib/email/receiver.rb b/lib/email/receiver.rb
index a6da67cbaa..38c8439f38 100644
--- a/lib/email/receiver.rb
+++ b/lib/email/receiver.rb
@@ -480,8 +480,12 @@ module Email
 
     def extract_from_mozilla(doc)
       # Mozilla (Thunderbird ?) properly identifies signature and forwarded emails
-      # Remove them and anything that comes after
-      elided = doc.css("*[class^='moz-'], *[class^='moz-'] ~ *").remove
+      # Remove them and anything that comes after. Leave in moz-txt-link- classes as they're links.
+      elided = doc.css("*[@class]:mozfilter", Class.new {
+        def mozfilter node_set
+          node_set.find_all { |node| node["class"] =~ /^moz-/ and node["class"] !~ /^moz-txt-link\b/ }
+        end
+      }.new).remove
       to_markdown(doc.to_html, elided.to_html)
     end

lib_email_receiver_rb-thunderbird_links.patch.txt (819 Bytes)

To fix a typo I’ve just spotted in my earlier post, to use this patch save this patch file in ~/lib_email_receiver_rb-thunderbird_links.patch.txt and then

mkdir -p /var/discourse/shared/standalone/patches
cp ~/lib_email_receiver_rb-thunderbird_links.patch.txt /var/discourse/shared/standalone/patches/

and then edit containers/app.yml as described above.

3 Likes
21

Thanks, works like a charm, except for the case of links with alias (like this one for example), which get separated …

1 Like
22

@Flominator Glad it’s at least partly working! I’d be keen to adapt the mozfilter part to not discard a link with alias. I hadn’t come across one like this, and haven’t been able to find documentation on thunderbird’s link classes. It’s not overly fancy though so it might not cope!
Would you be able to post or message me the HTML source in the email that created the post to have a look at? Thanks!

1 Like
23

It’s something like this:

    <p>some text, <a moz-do-not-send="true"
        href="https://ro.wikipedia.org/wiki/Crai_Nou,_Timi%C8%99">Links
        with alias</a> more text</p>
1 Like