US Patent 11406899 Virtual character generation from image or video data

Systems and methods for generating a customized virtual character are disclosed. A system may obtain video data or other media depicting a real person, and then may provide the obtained media to one or more machine learning models configured to learn visual appearance and behavior information regarding the particular person depicted in the video or other media. The system may then generate a custom visual appearance model and a custom behavior model corresponding to the real person, which may subsequently be used to render, within a virtual environment of a video game, a virtual character that resembles the real person in appearance and in-game behavior.