US Patent 6903738 Image-based 3D modeling rendering system

A method models a three-dimensional object by first acquiring alpha mattes of the object for multiple viewpoints. The alpha mattes are then projected onto a surface hull completely enclosing the object to construct an opacity hull storing opacity values of the surface of the object. The object is illuminated for various lighting conditions while images are acquired. The images are projected onto the opacity hull to render the object under arbitrary lighting conditions for arbitrary viewpoints.