US Patent 10356167 Workload profiling

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for profiling and configuring work on a cluster of computer nodes. One method includes a component controller designating running software components according to a component configuration, to operate on respective nodes within the cluster to process a workload; determining, for each component, current and historical quantities of resources used by the component when processing previous workloads; computing, for each workload operation, execution metrics that indicate resources used in nodes by the one or more components included in the workload operation; and generating one or more modified parameter values for the component configuration of a particular component or for the workload or for both, the component configuration and workload with the modified parameter values specifying a more optimum use of resources at the nodes in the cluster than the component configuration and workload without the modified parameter values.