US Patent 11663525 Augmenting unlabeled images of medically invasive devices via image processing

A system and method for augmenting unlabeled imaging data of invasive medical devices is disclosed. An imaging device can generate images of the invasive medical device inside a patient. A trained model for the invasive medical device can be trained on annotated images of the invasive medical device having labels indicating orientation and position information. An imaging computer system can apply the trained model to unlabeled images of the invasive medical device within the patient to determine a current orientation and a current position of the invasive medical device inside the patient. The images of the invasive medical device, visual orientation information representing the current orientation of the invasive medical device, and visual position information representing the current position of the invasive medical device inside the patient can be outputted to a display.