Yes. Go to the theme’s editor and click the ‘preview’ link that’s displayed on the bottom right of the page: