The Invisible Web
9 hours ago
- #Internet History
- #Invisible Web
- #Search Engines
- The Invisible Web refers to parts of the Internet not indexed by regular search engines.
- In 2001, it was predicted that the Invisible Web would grow faster than the public Internet.
- The Invisible Web includes specialized databases like phone directories and newspaper archives.
- Search engines use 'Spider Bots' or 'Crawlers' to index web pages, but sites without links remain invisible.
- Submitting a site to a search engine doesn't guarantee indexing, leading to many sites being overlooked.
- InvisibleWeb.com was a metasearch engine for specialized information but is now defunct.
- The domain InvisibleWeb.com went through several corporate acquisitions before being shut down.
- The prediction that search engines would struggle to keep up with Internet expansion is revisited.
- The Internet remains vast and undefeated in its complexity and growth.