US Patent 11037312 Technologies for thermal enhanced semantic segmentation of two-dimensional images

Technologies for thermal enhanced semantic segmentation include a computing device having a visible light camera and an infrared camera. The computing device receives a visible light image of a scene from the visible light camera and an infrared image of the scene from the infrared camera. The computing device registers the infrared image to the visible light image to generate a registered image. Registering the infrared image may include increasing resolution of the infrared image. The computing device generates a thermal boundary saliency image based on the registered infrared image. The computing device may generate the thermal boundary saliency image by applying a Gabor jet convolution to the registered infrared image. The computing device performs semantic segmentation on the visible light image, the registered infrared image, and the thermal boundary saliency image to generate a pixelwise semantic classification of the scene. Other embodiments are described and claimed.