Patent attributes
Techniques for simulating human interface interaction resilient to user interface changes are presented. Automated analysis is performed on an image of a user interface of a computer program that is to be a target of simulated user interactions, and that determines the location and interaction purpose of a particular control on the user interface. An interaction package is read, and it indicates one or more interaction purposes that are to be carried out through interactions with the user interface of the computer program. Interaction with the user interface is simulated to carry out the one or more interaction purposes, where the particular interaction purpose is among the one of the one or more interaction purposes and simulating user interactions includes simulating user interaction with the particular control, based on the determined location and particular interaction purpose.
