A method of semantic object detection in an image dataset includes extracting semantic links relevant to the image dataset. Objects are detected in the image dataset and confidence scores are assigned to the detected objects. The semantic object detection compares the detected objects with the semantic links and augments the confidence scores based on the semantic links between the detected objects.