It’s supposed to appear in the theme components settings, above Tag icon list.
It doesn’t work because the TC is looking for admin URL like /customize/components/, and discourse is now redirecting to /customize/themes/.
For now, until this is fixed, the old path still works and you can replace themes by components directly in the URL:
From:
To:
Then, the button appears:
