Patent attributes
A memory stores an environment file. A hardware processor receives a video file comprising a first frame and a second frame. The hardware processor determines a first object in the first frame and a first user action performed in the first frame. The hardware processor determines a second object in the second frame and a second user action performed in the second frame. The hardware processor determines a first keyword for the first user action and a second keyword for the second user action. The hardware processor determines, based on the first and second keywords, a first script and a second script from the environment file. The hardware processor then combines the first script and the second script to generate an automation script that, when executed, performs the first user action on the first object and the second user action on the second object.