US Patent 11983721 Computer software architecture for execution efficiency

The present disclosure pertains to an improved computing architecture allowing for better utilization of CPU, memory, network bandwidth, and other computing resources, particularly within the context of a decision service system that handles client requests. These methods and systems may be directed to the evaluation and use of a partial response from a decision service system when the generation of a full response by the decision service system is predicted to take longer than what is expected.