fixtures :only and :except ?

Are there any ways to exclude fixtures from being loaded in certain methods in a test suite? It seems like when you define a fixture it has to be loaded for every method no matter what and you have no control over it. Is that true?