How can I customise CSS for each category? (as in having different design for each category)

Isn’t it only a matter of using the correct selector(s)?

eg. the body tags class value should have a category specific value you could use.