Note belongs_to Company or Contact?

Note can belong to more than one model. For this u need polymorphic
association. Define notable model with polymorphic as true. Other
model that use has many declaration with :as notable in it