US Patent 7082578 Computer user interface using a physical manipulatory grammar

A method for inputting information to a device connected to a deformable piece includes the steps of manipulating the deformable piece to provide a first morpheme input to the device. The first morpheme input normally triggers a first default action by the device, such as controlling a display, modifying a data structure, or communicating with another electronic device. When a user asynchronously manipulates the deformable piece to provide a second morpheme input to the device, the second morpheme input converts the normally triggered first default action to a second action generally not equivalent to the first default action. This mode of interaction allows formation of morphemic sentences to control a graspable device.