After updating Discourse, you can now add some HTML to the text for this feature, in both the title and body text. The relevant translations are:
- admin/customize/site_texts?q=signup_cta.value
- admin/customize/site_texts?q=signup_cta.intro
https://github.com/discourse/discourse/pull/36668
Thanks for posting about it!