Patent 10013340 was granted and assigned to Amazon on July, 2018 by the United States Patent and Trademark Office.
Technology is described for selecting parameter combinations corresponding to virtual instance configurations to be tested in a virtual computing environment and for performing tests in a plurality of parallel test pipelines. Throttling constraints can be applied so that resources used by the test pipelines in the testing process do not exceed predefined limits.