US Patent 11450024 Mixed depth object detection

A method includes obtaining a point cloud captured by a depth sensor, and image data captured by an image sensor, the point cloud and the image data representing a support structure bearing a set of objects; obtaining an image boundary corresponding to an object from the set of objects; determining a portion of the point cloud corresponding to the image boundary; selecting, from the determined portion, a subset of points corresponding to a forward surface of the object; and generating a three-dimensional position of the object based on the forward surface.