Yes, you’ll need to add custom CSS in a theme.
We have a couple guides to get you started on themes:
Beginner's guide to using Discourse Themes
Developing Discourse Themes & Theme Components
If you’re not familiar with CSS you can post what you’re trying to accomplish in Marketplace and you’ll likely find someone that can help.