Abstract In this paper, we present Google, a prototype of a large-scale search engine which makes heavyuse of the structure present in hypertext. Google is designed to crawl and index the Web efficientlyand produce much more satisfying search results than existing systems. The prototype with a fulltext and hyperlink database of at least 24 million pages is available at http://google.stanford.edu/To engineer a search engine is a challenging task. Search engines index tens to hundreds ofmillions of web pages involving a comparable number of distinct terms. They answer tens ofmillions of queries every day. Despite the importance of large-scale search engines on the web,very little academic research has been done on them. Furthermore, due to rapid advance intechnology and web proliferation, creating a web search engine today is very different from threeyears ago. This paper provides an in-depth description of our large-scale web search engine -- thefirst such detailed public description we know of to date. Apart from the problems of scalingtraditional search techniques to data of this magnitude, there are new technical challenges involvedwith using the additional information present in hypertext to produce better search results. Thispaper addresses this question of how to build a practical large-scale system which can exploit theadditional information present in hypertext. Also we look at the problem of how to effectively dealwith uncontrolled hypertext collections where anyone can publish anything they want.

» Free PDF eBooks Download
» Search Engine Google