Patent attributes
A knowledge base is generated based on eye tracking, audio monitoring and image annotations, for determining image features from given images and sequences of image features to focus on in analyzing an image. An eye tracker monitors eye movements of a user analyzing an image and generates a sequence of eye movements. A user interface receives annotations on the image. Audio data received via a microphone is translated into text and keywords are extracted. The sequence of eye movements, the annotations and the keywords are correlated according to their time of occurrence. Image features are extracted from the image and mapped with the sequence of eye movements, the annotations and the keywords that are correlated. A recurrent neural network model is generated based on the mapped image features and predicts a likelihood of an expert image analyzer focusing on a feature in a given new image.
