In the summer of 1993, no search engine existed for the web, though numerous specialized catalogues were maintained by hand.
Around 2000, Google's search engine rose to prominence.
The company achieved better results for many searches with an innovation called Page Rank, as was explained in the paper Anatomy of a Search Engine written by Sergey Brin and Larry Page, the later founders of Google.
One of the first "all text" crawler-based search engines was Web Crawler, which came out in 1994.
Unlike its predecessors, it allowed users to search for any word in any webpage, which has become the standard for all major search engines since.
The program downloaded the directory listings of all the files located on public anonymous FTP (File Transfer Protocol) sites, creating a searchable database of file names; however, Archie Search Engine did not index the contents of these sites since the amount of data was so limited it could be readily searched manually.
The rise of Gopher (created in 1991 by Mark Mc Cahill at the University of Minnesota) led to two new search programs, Veronica and Jughead.Some have taken down their public search engine, and are marketing enterprise-only editions, such as Northern Light.Many search engine companies were caught up in the dot-com bubble, a speculation-driven market boom that peaked in 1999 and ended in 2001.A web search engine is a software system that is designed to search for information on the World Wide Web.The search results are generally presented in a line of results often referred to as search engine results pages (SERPs).The information may be a mix of web pages, images, and other types of files.