Hide '+ New Topic' button from home screen

Don’t do that. That will break your site.

Instead the following CSS customization will do what you want

.nav.nav-pills { display: none; }
.full-width .nav.nav-pills { display: block; }

Edit: Added .full-width style too, otherwise, the admin nav can disappear.