US Patent 10091556 Relating items to objects detected in media

Disclosed are various embodiments for relating items to objects detected in media. An item recognition application obtains media information associated with a broadcast being consumed form the client device. The item recognition application identifies objects in the media based on user input of the location of the object on the client device display and/or heuristic detection of the object. The user may indicate the object's location through an input device. The object may be heuristically detected based on an algorithm that differentiates the object from the background. The item recognition application identifies items related to the object. The item recognition application then performs an action with the item.