US Patent 9717607 Augmented control of robotic prosthesis by a cognitive system

Embodiments of the present invention provides for one or more processors receive image data of an object selected by a user and determine image attributes of the object selected, based on image analytics on the image data. One or more processors determine whether the image attributes of the object selected match an identified object of a knowledge base, in which an identified object includes image attributes and manipulation data corresponding to the identified object, and responsive to determining that the object selected by the user of the prosthetic device matches an identified object of the knowledge base, one or more processors transmits manipulation data corresponding to the identified object matching the object selected by the user, to a mobile controlling device communicatively connected to the prosthetic device, wherein the mobile controlling device applies the manipulation data corresponding to the identified object to the prosthetic device.