Patent attributes
Aspects of the disclosure provide methods and apparatuses for subjective evaluation. In some examples, processing circuitry receives scores graded by a subject to a media presentation. The scores by the subject includes a plurality of self comparison scores that are graded to self comparison tests in the media presentation. The processing circuitry applies a first rule and a second rule to the plurality of self comparison scores. The first rule requires a first subset of the plurality of self comparison scores in a first range. The second rule requires a second subset of the plurality of self comparison scores in a second range to limit at least an outlier to the first rule according to the second range. The processing circuitry determines that the scores by the subject are qualified for the subjective evaluation in response to the first rule and the second rule being satisfied.
