US Patent 11257217 Image segmentation using neural networks

A method for generating a segmentation of an image that assigns each pixel to a respective segmentation category from a set of segmentation categories is described. The method includes obtaining features of the image, the image including a plurality of pixels. For each of one or more time steps starting from an initial time step and continuing until a final time step, the method includes generating a network input from the features of the image and a current segmentation output as of the time step, processing the network input using a convolutional recurrent neural network to generate an intermediate segmentation output for the time step, and generating an updated segmentation output for the time step from the intermediate segmentation output for the time step and the current segmentation output as of the time step. The method includes generating a final segmentation of the image from the updated segmentation output.