US Patent 9544528 Matrix search of video using closed caption information

Closed caption data for video programs, such as television programs, may be used to implement a video search. In one implementation, a device may perform a search to obtain video programs that are relevant to the search. The search may be performed using an index generated from closed caption data of video programs. The device may additionally present the video programs that are relevant to the search as a matrix of reduced-in-size images sampled from the video programs that are relevant to the search query. The images may be sampled from the video programs near a position in the video programs corresponding to the positions at which the search query is relevant to the video program.