It doesn’t show thumbnails, but there is a theme component that allows for icons:
That topic has a slick install modal that will help you install it on your site, very cool! 
Make sure to set category style to an option other than “bullet”, for the changes to appear.