Can't find how to localize a theme component

Yes, this is accurate. We haven’t added an interface for editing theme translations, so you have to change your language first from your account preferences (community.example.com/my/preferences/interface). Then if you visit admin/customize/themes you’ll be editing the text for the currently selected locale.