US Patent 9378554 Real-time range map generation

A system, method, and non-transitory computer-readable storage medium for range map generation is disclosed. The method may include receiving an image from a camera and receiving a 3D point cloud from a range detection unit. The method may further include transforming the 3D point cloud from range detection unit coordinates to camera coordinates. The method may further include projecting the transformed 3D point cloud into a 2D camera image space corresponding to the camera resolution to yield projected 2D points. The method may further include filtering the projected 2D points based on a range threshold. The method may further include generating a range map based on the filtered 2D points and the image.