Every user-query generates a
unique web page whose contents are determined by the query
parameters.The number of singular pages thus capable of being
generated is mind boggling. Search engines operate on the same
principle - vary the search parameters slightly and
totally new pages are generated. It is a dynamic, user-
responsive and chimerical sort of web.
These are good examples of what www.brightplanet.com call the
"Deep Web" (previously inaccurately described as the "Unknown
or Invisible Internet"). They believe that the Deep Web is 500
times the size of the "Surface Internet" (a portion of which
is spidered by traditional search engines). This translates to
c. 7500 TERAbytes of data (versus 19 terabytes in the whole
known web, excluding the databases of the search engines
themselves) - or 550 billion documents organized in 100,000
deep web sites. By comparison, Google, the most comprehensive
search engine ever, stores 1.4 billion documents in its
immense caches at www.google.com. The natural inclination
to dismiss these pages of data as mere re-arrangements of the
same information is wrong.
Pages:
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213