US Patent 10324293 Vision-assisted input within a virtual world

A user wearing a virtual reality headset and holding a real-world input device, uses a finger to input data into the real-world input device under visual assistance within the virtual world. A corresponding virtual input device is positioned within the virtual world in a position similar to the position of the real-world input device relative to the headset, and a fingertip marker upon an input map of the virtual input device in the virtual world is positioned similar to the position of the real-world user's fingertip relative to the real-world input device, thus providing realistic visual assistance in the virtual world for reaching and stroking the desired key or point on the real-world input device.