US Patent 11079840 Operation determination device and operation determination method

An operation determination device determines an operation performed by a user in a non-contact manner on a display image. An image acquisition unit acquires a photographed image of the user, and an image processing unit performs image processing on the photographed image and determines the position of the line-of-sight of the user, the position of the fingertip, and the movement of the fingertip with respect to the display image. The image processing unit includes a first processing unit configured to detect the positions of the eyes and fingertip of the user in the photographed image, and a second processing unit that calculates the position of the user's sight line and fingertip with respect to the display surface based on the detected positions of the user's eyes and the fingertip in the photographed image and that determines a movement of the user's fingertip.