Deep web

The deep web (or sometimes dark net) refers to resources on the web that are not accessible to web crawlers - and therefore not discoverable via search engines.

Example

  • content that is blocked using robots.txt.
  • content that is only available via a login - such as non-public Facebook profiles.
  • content that can only be exposed through user provided search terms.

Not to be confused with Tor hidden services, which may include content inaccessible to web crawlers, which may also be publicly available.

Retrieved from "https://wiki.openrightsgroup.org/w/index.php?title=Deep_web&oldid=50437"