US Patent 11620577 Multi-modal data explainer pipeline

Embodiments of the present invention provide a computer system, a computer program product, and a method that comprises ingesting tabular data from at least one modality of a plurality of modalities; simultaneously extracting data and generating a prediction model for a task of a computing device from the extracted data from at least two modalities in the plurality of modalities; generating a data signature based on the generated prediction model from the at least two modalities by leveraging the generated prediction model for ingested tabular data and extracted data; comparing the generated data signature to identified data signatures stored in at least one modality in the plurality of modalities; and performing a task based on the generated data signature and a validation of the comparison of identified data signatures.