It’s possible to customize the text from (admin > customize > text) — searching for “with google” should pull up what you need to edit
The logo on the button can be hidden with CSS added to a theme (admin > customize > themes):
.btn-social.google_oauth2 .d-icon {
display: none;
}
Fair warning though, there is some history of Google checking for compliance with their specs and sending warning emails to admins… something as minor as using the wrong color has caught their attention before: Not compliant with google signin branding requirements