US Patent 10409712 Device based visual test automation

A device may receive test scripts that include first information identifying first elements of user interfaces or second information identifying test steps. The test scripts may be written in first text or first program code. The device may process the first text or the first program code of the test scripts. The device may identify the first elements on the user interfaces. The first elements may be identified without using second program code associated with the user interfaces. The first elements may be identified based on a type of the first elements, second text associated with the first elements, or a relationship between the first elements and second elements. The device may identify positions for the first elements. The positions may permit the device to interact with the first elements to perform the test steps. The device may perform the test steps to test the user interfaces.