Smoke-testing plugins during upgrade process

[codinghorror (Jeff Atwood)]

I think at minimum we should invalidate all unofficial plugins on every version change. As in, they should all be default-off.