US Patent 7446803 Synchronous video and data annotations

A video surveillance system captures video of a protected area, stores the video in a computer readable memory, stores data annotations in the computer readable memory where the data annotations are searchable using a search criteria, and stores links that link the stored data annotations to corresponding video segments of the stored video so that the data annotations can be used to search for a video segment of interest. The data annotations are searched using the search criteria, and the video segment of interest linked to the data annotation found as a result of the search is displayed.