Check plugin or theme validity

Just a thought. Might it be possible to run tests alone?

spitball: a way to install the tests from the repository without installing and running the plugin?