The internet provides a wealth of information but finding it can be problematic. There currently exist a number of sites and technologies to help us. When we enter phrases and keywords into a search site, the list of pages and sites returned will be the result of 2 processes ...
It is not always clear what technologies a given search site uses, and it doesn't matter to the average surfer, but it is important to web developers and site builders.
The term "search engine" has become somewhat generic and is used to describe a search site or search technology. Because it is non-specific I will avoid it here.
A Search Information System (my term) is the people, hardware and software that comprises an index or directory. Its aim is to index and categorise web sites and their pages and to provide the most accurate and useful results to someone using a Search Site to search the Search Technology System. It is important to distinguish between a Search Site and a Search Information System because some search site companies use other companies Search Technology Systems. More on this later.
There are 2 primary types of search technology system ...
A search index comprises several elements ...
In July 2006 the most popular indexes were ...
In March 2010 ...
These statistics can be found at searchenginewatch.com/
Search directories contain information about sites but not the actual content and information itself. They describe and categorise sites. These organisations and companies do not pro-actively find sites to index, they reply on site owners submitting their sites for consideration. People, not spiders, oversee entries in the directory. The important ones are ...
Open Directory Project ... www.dmoz.org
A Search Site provides a web interface to allow you to search a Search Technology System (an index or directory or both). Some Search Sites search the indexes and/or directories they own (such as www.google.com), whilst others are simply interfaces for searching another companies' or organisation's index and/or directory.
|Search site||Search technology systems used|
|aol.com||Google & Open Directory Project|
|www.google.com||Google & Open Directory Project|
|www.dir.google.com||Open Directory Project|
|www.earthlink.com||Google & Open Directory Project|
|www.dmoz.org (Open Directory Project)||Open Directory Project|
|www.ask.com / www.askjeeves.com||Ask|
|www.netscape.com||Google & Open Directory Project|