Patent 11980527 was granted and assigned to Electronics and Telecommunications Research Institute on May, 2024 by the United States Patent and Trademark Office.
Provided is a sensory substitution apparatus and method that combines two or more pieces of multi-sense sensory information to be converted into different multi-sense sensory information, in which received pieces of multiple information are combined to suit sensory characteristics of the user's body and efficiently transmitted to a different sensory organ. According to the present invention includes: receiving input sensory information; classifying the input sensory information; calculating an importance of each of individual sensory information; determining a target sense for which part or all of the individual sensory information, of which an importance is calculated, is to be converted into a new sensory signal incongruent with the corresponding individual sense; and converting the input sensory information into target sensory information to be transmitted to the determined target sense which is an organ.