Embodiments of the invention relate to a method for determining that an object in a sequence of images is a human. The method may include the steps of detecting an object in a first image from the sequence of images and assigning a first score to the object. The object is tracked to a second image from the sequence of images and a second score is assigned to the object in the second image. The second score is compared to a threshold that is inversely related to the first score and a determination that the object in the second image is a human is made based on the comparison.