US Patent 11257574 Information system providing explanation of models

A health care information system generates information that describes how different inputs to a model affect the output of the model, by creating a localized model for a given entity, and determining how the output of the localized model for the given entity changes in response to different inputs. The computer system builds the localized model for a given entity based on the model and on data values for the given entity. The computer system inputs one or more different data values for selected input features of the localized model, while data values for the remaining input features of the localized model are fixed to data values for the given entity, and obtains corresponding outputs from the localized model. The results from this localized model for the given entity indicate which of the selected input features have the most impact on the output of the model for that entity.