US Patent 11954473 Deployment architecture for multi-tenant cloud computing systems

Methods, systems, and apparatus, including computer programs encoded on computer-storage media, for a deployment architecture for multi-tenant cloud computing systems. In some implementations, a first cluster of processing nodes is configured to run tenant computing environments on behalf of different tenants. A second cluster of processing nodes runs a deployment controller configured to manage and monitor tenant computing environments allocated for the first cluster of processing nodes. A pool of unassigned computing environments is hosted in the first cluster of processing nodes. After receiving a request for a new environment, the deployment controller running in the second cluster of processing nodes coordinates with one or more modules running in the first cluster of processing nodes to update and assign one of the previously unassigned computing environments to be used.