US Patent 11983800 Generation of pseudo radiographic images from optical images

The invention provides for a medical instrument comprising a memory storing machine executable instructions and an image transformation neural network trained for transforming an optical image of a subject into an output image. The output image comprises a pseudo radiographic image. The pseudo radiographic image is aligned with the optical image. The medical instrument further comprises a processor configured to control the medical imaging system. Execution of the machine executable instructions causes the processor to: receive the optical image of the subject and generate the output image by inputting the optical image into the image transformation neural network.