US Patent 10901823 System and method for load balancing in computing systems

A system and method to balance computational loads across multiple computing systems, such as servers in a server cluster, is disclosed. The system includes a load balancer. Upon receiving a new computing request corresponding to an expected throughout, the load balancer identifies a computing system that is most likely to fail and sends the new computing request to a different computing system. The load balancer uses a mutational algorithm to identify potentially problematic throughputs for a given computing system in a given state. The mutational algorithm is used to determine latency-throughput curves that are fit to a data population that includes many diverse data points with relatively high slopes in a 2D latency-throughput space.