US Patent 10157491 Real-time scene-modeling combining 3D ultrasound and 2D X-ray imagery

An apparatus for visualizing image material in a multimodal imaging environment. Images (XF, USV) from an X-ray imager (100) and an ultrasound probe (USP) are fused into an interactive graphics display (GUI) to form a 3D scene, where, alongside to a 3D rendering (USS) of an ultrasound volume (USV) an X-Ray projection plan (XF) is displayed in perspective within the same scene. The rendering is according to a user selected view (UV) which is changeable upon user interaction with the interactive graphics display (GUI).