A method of representing and analyzing images comprises producing a plurality of descriptors of an image at one or more scales and for one ore more color channels, said descriptors capturing color content and interrelation information within the regions, and associating the descriptors in a plurality of ways based on their characteristics such as scale, color channel, feature semantics, and region, and comparing such representations of images to assess the similarity of images.