|
|
= How Big is the Dark Web? =
|
|
|
Common media interpretations of the size of the "dark web", such as an early 2014 [http://www.businessweek.com/articles/2014-01-23/tor-anonymity-software-vs-dot-the-national-security-agency Businessweek article], indicate that the dark web is very large:
|
|
|
# How Big is the Dark Web?
|
|
|
Common media interpretations of the size of the "dark web", such as an early 2014 [Businessweek article](http://www.businessweek.com/articles/2014-01-23/tor-anonymity-software-vs-dot-the-national-security-agency), indicate that the dark web is very large:
|
|
|
|
|
|
"In addition to facilitating anonymous communication online, Tor is an access point to the "dark Web," vast reaches of the Internet that are intentionally kept hidden and don't show up in Google or other search engines, often because they harbor the illicit, from child porn to stolen credit card information."
|
|
|
|
|
|
This, however, appears to be misleading; and may impact on and cause [http://en.wikipedia.org/wiki/Fear,_uncertainty_and_doubt FUD] for those not generally exposed to Tor and other elements of the dark web.
|
|
|
This, however, appears to be misleading; and may impact on and cause [FUD](http://en.wikipedia.org/wiki/Fear,_uncertainty_and_doubt) for those not generally exposed to Tor and other elements of the dark web.
|
|
|
|
|
|
One of the elements which may cause confusion is the definition of "dark web" vs the definition of "deep web". Unfortunately, some sites don't distinguish between the deep and dark web. As a result the two words have [http://blog.dictionary.com/dark-web/ become confused] in general usage, leading to a drift in meaning.
|
|
|
One of the elements which may cause confusion is the definition of "dark web" vs the definition of "deep web". Unfortunately, some sites don't distinguish between the deep and dark web. As a result the two words have [become confused](http://blog.dictionary.com/dark-web/) in general usage, leading to a drift in meaning.
|
|
|
|
|
|
== Definitions ==
|
|
|
'''Web''': the portion of the Internet which is accessible via a web browser; the World Wide Web.
|
|
|
## Definitions
|
|
|
**Web**: the portion of the Internet which is accessible via a web browser; the World Wide Web.
|
|
|
|
|
|
'''Deep web''' (search): information which is not registered with any search engine (definition as per the August 2001 paper [http://quod.lib.umich.edu/cgi/t/text/text-idx?c=jep;view=text;rgn=main;idno=3336451.0007.104 The Deep Web: Surfacing Hidden Value] from the Journal of Electronic Publishing). This includes information which is housed in databases and which is only viewable through dynamic pages generated when the content is requested, and information which resides behind authentication such as on private organizational networks and public networks such as Facebook.
|
|
|
**Deep web** (search): information which is not registered with any search engine (definition as per the August 2001 paper [The Deep Web: Surfacing Hidden Value](http://quod.lib.umich.edu/cgi/t/text/text-idx?c=jep;view=text;rgn=main;idno=3336451.0007.104) from the Journal of Electronic Publishing). This includes information which is housed in databases and which is only viewable through dynamic pages generated when the content is requested, and information which resides behind authentication such as on private organizational networks and public networks such as Facebook.
|
|
|
|
|
|
'''Deep web''': Often confusingly used as a synonym for Dark web
|
|
|
**Deep web**: Often confusingly used as a synonym for Dark web
|
|
|
|
|
|
'''Dark web''': that portion of the web which cannot be easily reached from the public Internet, and usually requires specialized software to access. Examples of the dark web are the Tor network and hidden services, the I2P network and its eepsites, and the !RetroShare network.
|
|
|
**Dark web**: that portion of the web which cannot be easily reached from the public Internet, and usually requires specialized software to access. Examples of the dark web are the Tor network and hidden services, the I2P network and its eepsites, and the RetroShare network.
|
|
|
|
|
|
'''Public Internet''': the 'regular' Internet, available for all to use, and open to filtering/censorship by governments and ISPs.
|
|
|
**Public Internet**: the 'regular' Internet, available for all to use, and open to filtering/censorship by governments and ISPs.
|
|
|
|
|
|
'''Private network''': a computer network which is reserved for specific purposes, e.g. company networks.
|
|
|
**Private network**: a computer network which is reserved for specific purposes, e.g. company networks.
|
|
|
|
|
|
'''Overlay network''': a computer network which is built on the top of another network. Nodes in the overlay can be thought of as being connected by virtual or logical links, each of which corresponds to a path, perhaps through many physical links, in the underlying network [[https://en.wikipedia.org/wiki/Overlay_network Wikipedia]].
|
|
|
**Overlay network**: a computer network which is built on the top of another network. Nodes in the overlay can be thought of as being connected by virtual or logical links, each of which corresponds to a path, perhaps through many physical links, in the underlying network [[Wikipedia](https://en.wikipedia.org/wiki/Overlay_network)].
|
|
|
|
|
|
== Size ==
|
|
|
Size depends on exactly how we categorize things. For the purposes of this article we're talking about the ''web'', i.e. the portions of the Internet which are accessible from a web browser; not the entire Internet itself. So from here, bearing in mind that we're discussing the dark ''web'' and the deep ''web'':
|
|
|
## Size
|
|
|
Size depends on exactly how we categorize things. For the purposes of this article we're talking about the _web_, i.e. the portions of the Internet which are accessible from a web browser; not the entire Internet itself. So from here, bearing in mind that we're discussing the dark _web_ and the deep _web_:
|
|
|
|
|
|
The deep web is claimed to be approximately 500 times larger than the public Internet, based on figures in the ''Surfacing Hidden Value'' report above and on others (e.g. [http://websearch.about.com/od/invisibleweb/a/invisible_web.htm About.com]), although these others often only reference the paper above.
|
|
|
The deep web is claimed to be approximately 500 times larger than the public Internet, based on figures in the _Surfacing Hidden Value_ report above and on others (e.g. [About.com](http://websearch.about.com/od/invisibleweb/a/invisible_web.htm)), although these others often only reference the paper above.
|
|
|
|
|
|
The dark web, however, is considered to be much smaller. There are likely to be 1-2000 Tor hidden services [ [http://freehaven.net/anonbib/#oakland2013-trawling freehaven.net], [http://donncha.is/2013/05/trawling-tor-hidden-services/ donncha.is] ], although this is very hard to establish as hidden services are, by design, hidden! There are currently approximately [https://metrics.torproject.org/users.html 3,000,000 Tor users]; this provides an upper bound on the number of hidden services, and it is likely that few of these user actually run hidden services.
|
|
|
The dark web, however, is considered to be much smaller. There are likely to be 1-2000 Tor hidden services [ [freehaven.net](http://freehaven.net/anonbib/#oakland2013-trawling), [donncha.is](http://donncha.is/2013/05/trawling-tor-hidden-services/) ], although this is very hard to establish as hidden services are, by design, hidden! There are currently approximately [3,000,000 Tor users](https://metrics.torproject.org/users.html); this provides an upper bound on the number of hidden services, and it is likely that few of these user actually run hidden services.
|
|
|
|
|
|
Should we expand the discussion to include all of the dark ''networks'' then the discussion becomes a little less clear. P2P, VPN and VoIP networks are all overlay networks, and may be considered dark networks in the same manner as the dark web above (specialized software is required for access). Tor is not the only dark or overlay network. Sizes of other dark networks such as I2P and !RetroShare are hard to gauge; however based on popularity it would appear reasonable to guess that, in total, the size of dark networks combined is far smaller that the deep web, and highly likely to be smaller than the public Internet.
|
|
|
Should we expand the discussion to include all of the dark _networks_ then the discussion becomes a little less clear. P2P, VPN and VoIP networks are all overlay networks, and may be considered dark networks in the same manner as the dark web above (specialized software is required for access). Tor is not the only dark or overlay network. Sizes of other dark networks such as I2P and RetroShare are hard to gauge; however based on popularity it would appear reasonable to guess that, in total, the size of dark networks combined is far smaller that the deep web, and highly likely to be smaller than the public Internet.
|
|
|
|
|
|
== Conclusion ==
|
|
|
The dark ''web'' is not really all that large. Important, but not "vast reaches of the Internet", and certainly not as large as the ''deep'' web. Overlay or dark ''networks'' may indeed be very large, as well as being more accepted as part of 'regular' Internet technology.
|
|
|
## Conclusion
|
|
|
The dark _web_ is not really all that large. Important, but not "vast reaches of the Internet", and certainly not as large as the _deep_ web. Overlay or dark _networks_ may indeed be very large, as well as being more accepted as part of 'regular' Internet technology.
|
|
|
|
|
|
== Related ==
|
|
|
## Related
|
|
|
Some related and positive (or at least not entirely negative) articles:
|
|
|
|
|
|
* [http://www.wired.com/opinion/2013/10/thompson/ The Darkest Place on the Internet Isn’t Just for Criminals]
|
|
|
* [http://www.pcworld.com/article/2046227/meet-darknet-the-hidden-anonymous-underbelly-of-the-searchable-web.html Meet Darknet, the hidden, anonymous underbelly of the searchable Web]
|
|
|
* [http://askthecomputerguy.com/opinions/dark-net-101/ What is Dark Net?]
|
|
|
* [https://www.deepdotweb.com/2015/06/08/the-dark-web-deep-web-and-dark-net-terminology-hell/ The Dark Web, Deep Web and Dark Net – Terminology Hell]
|
|
|
* [https://www.truthfinder.com/infomania/technology/deep-web-dark-web-urban-legends/ Has The Deep Web Become The Modern Day Bigfoot?]
|
|
|
* [http://rationalwiki.org/wiki/Deep_Web RationalWiki:Deep Web] |
|
|
\ No newline at end of file |
|
|
* [The Darkest Place on the Internet Isn’t Just for Criminals](http://www.wired.com/opinion/2013/10/thompson/)
|
|
|
* [Meet Darknet, the hidden, anonymous underbelly of the searchable Web](http://www.pcworld.com/article/2046227/meet-darknet-the-hidden-anonymous-underbelly-of-the-searchable-web.html)
|
|
|
* [What is Dark Net?](http://askthecomputerguy.com/opinions/dark-net-101/)
|
|
|
* [The Dark Web, Deep Web and Dark Net – Terminology Hell](https://www.deepdotweb.com/2015/06/08/the-dark-web-deep-web-and-dark-net-terminology-hell/)
|
|
|
* [Has The Deep Web Become The Modern Day Bigfoot?](https://www.truthfinder.com/infomania/technology/deep-web-dark-web-urban-legends/)
|
|
|
* [RationalWiki:Deep Web](http://rationalwiki.org/wiki/Deep_Web) |
|
|
\ No newline at end of file |