US Patent 7869658 Representative image selection based on hierarchical clustering

In a computer-mediated method for providing representative images, image records are classified spatio-temporally into groups. In each group, image records are partitioned into clusters and the hierarchically highest cluster is ascertained. The partitioning is between a hierarchy of feature clusters and a remainder cluster, based on a predetermined plurality of saliency features. Feature clusters each have one or more of the saliency features. The remainder cluster lacks the saliency features. Feature clusters are each exclusive of the saliency features of any higher clusters in the hierarchy and non-exclusive of the saliency features of any lower feature clusters in the hierarchy. A representative image of each group is designated from respective image records based on: the respective saliency feature of the highest cluster when the highest cluster is a feature cluster and independent of the saliency features when the highest cluster is the remainder cluster.