Gems live in a directory like /usr/local/lib/ruby/gems/ and can be shared/used by any rails app. Plugins are installed into a sub-directory of your rails app at /vendor/plugins. A plugin can only be used in the rails app it is installed in.
Hope this helps,