Is it worth a hassle? We write lots of plugin all covered with tests.
We don't include tests with plugins though but each plugin development
tree has its own rails application just for testing the plugin. For
example, to install our ActsAsSecure plugin, you run 'script/plugin
As you can see it is located under vendor/plugin while the tests are
under svn://rubyforge.org/var/svn/acts-as-secure/trunk/test. It does
not give others an ability to run tests for your plugin (unless they
check out the whole app just for that) but it makes it much easier for
you to test it during development.