US Patent 11935125 Digital imagery, audio, and meta-data

Methods, systems, and apparatus, including computer programs encoded on computer storage media, to process audio and visual data. One of the methods includes receiving, from a mobile device, image data and audio data, wherein the image data and audio data were obtained within the same time frame. The method includes processing the image data to identify a first set of facts. The method includes processing the audio data to identify a second set of facts. The method includes processing meta-data associated with the image data to identify a third set of facts. The method also includes performing at least one process using the first set of facts, the second set of facts, and the third set of facts.