While a bright category color isn’t an issue on dark themes because it’s often just used on a bullet or a border, it’s sometimes quite aggressive when displayed as a category banner background:
I suggest a setting that automatically tones down certain category colors, depending on their brightness.