I don't know if this might work, but you could give it a shot.
class Doctor belongs_to :office has_many :holidays, :through => Office, :conditions => ['doctor_id = NULL OR doctor_id = ?',self.id] end
There's a very good chance this might not work, so perhaps instead of an association, maybe you could use a named_scope instead.
