Patent 7991762 was granted and assigned to Google on August, 2011 by the United States Patent and Trademark Office.
Crawling pages is disclosed. Pages are crawled up to a target number of pages. Additional pages, that have an importance that is equal to or greater than an importance threshold, are crawled beyond the target number of pages. In some embodiments, pages having an importance less than an importance threshold are deleted.