US Patent 10530845 Shuffle sharded load balancing

A system includes a plurality of computing devices configurable to implement a compute instance of a provider network. A computing device is configured to implement a load balancer that allocates the computing devices to service requests received by the load balancer. The load balancer configured to receive service requests from a plurality of sources, to extract a parameter from each received service request, to select, based on the parameter, a first subset of the plurality of computing devices to be used to service the request, and to forward the request to a selected computing device of the first subset of the computing devices for service.