US Patent 11972223 Query evaluation in natural language processing systems

A system may determine relevance prompts based on input documents and a relevance prompt template and may transmit the plurality of relevance prompts to a large language model for completion. The system may receive response messages including chunk relevance scores. The system may select a subset of the input documents based on the chunk relevance scores. The system may determine query response prompts including text from the selected input documents the natural language query, and a second set of natural language instructions to address the natural language query. The system may determine a response to the natural language query based on answers determined in response to the query response prompts.