US Patent 11132550 Detecting shelf interactions using a sensor array

An object tracking system includes a sensor and a tracking system. The sensor is configured to capture a frame of at least a portion of a rack within a global plane for a space. The tracking system is configured to receive the frame, to detect an object within a zone of the frame, and to determine a pixel location for the object. The tracking system is further configured to identify a zone and a shelf of the rack based on the pixel location, to identify an item based on the identified zone and the identified shelf of the rack, and to add the identified item to a digital cart associated with a person.