In title, "''' are converted in " ›"

Yes, you need to rebake. If you have over 10K or 100K posts it might be worth trying to rebake only the necessary ones, otherwise, it’s easiest to just rebake them all.

Enter <yoursite>/admin/upgrade as the url.