US Patent 10928982 Automatic grouping of user interface elements into components

Techniques are disclosed relating to grouping user interface elements into components. The disclosed techniques may include, for example, determining, based on hierarchical user interface code, a plurality of visible elements of a graphical user interface. In addition, the disclosed techniques include determining coordinates for bounding boxes for ones of the plurality of visible elements and determining depths within the hierarchical user interface code for the plurality of visible elements. The disclosed techniques include generating groupings for the plurality of visible elements using unsupervised clustering and the determined coordinates and depths and storing information specifying the generated groupings.