Basically that’s not possible to override the discourse/app/assets/javascripts/discourse/app/components/header/auth-buttons.gjs at main · discourse/discourse · GitHub template but we can add a header button before or after auth buttons.
So the component is adding a button before the auth buttons like how it’s explained here: Upcoming Header Changes - Preparing Themes and Plugins and hide the default signup button with CSS.