Patent attributes
A better configuration for a computerized system is determined by performing a first stage and a second stage. In the first stage, the performance of each system configuration, including candidate configurations and a standard configuration, is evaluated, and the number of scenarios needed in the second stage is determined. In the second stage, the performance of each scenario of the standard configuration is evaluated, and the mean thereof is determined. For each candidate configuration, the performance of each scenario of the candidate configuration is evaluated, and the mean thereof is determined. Where the candidate configuration's mean is greater than the standard configuration's mean by a threshold, it is selected as the better configuration. Where no candidate configuration's mean is greater than the standard configuration's mean by the threshold, the standard configuration is selected as the better configuration.
