masthead for Beyond Google: The Invisible Web with a spiderweb next to it

How to Tame, Mine, or Harvest The “Invisible Web”

1. Directories:

Open Directory Project - "...largest human-edited directory of the Web"
www.dmoz.org

Infomine: Scholarly Internet Research Collection from the University of California-Riverside
http://infomine.ucr.edu

Digital Librarian maintained by Margaret Vail Anderson, a librarian
www.digital-librarian.com

Internet Public Library (ipl2) - Represents the merger of Internet Public Library with the Librarians Internet Index.
www.ipl.org

2. Pathfinders:

Boswell, Wendy. The Invisible Web: How To Find and Search the Invisible Web. About.com. 2009.
http://websearch.about.com/od/invisibleweb/a/invisible_web.htm

A tutorial from the UC Berkeley Library. Invisible or Deep Web: What It Is, How to Find It, And Its Inherent Ambiguity. 2012.
www.lib.berkeley.edu/TeachingLib/Guides/Internet/InvisibleWeb.html

Ultimate Guide to the Invisible Web
http://oedb.org/library/college-basics/invisible-web

3. Search Tools:

http://base.ub.uni-bielefeld.de/en/index.php - BASE - Bielefeld Academic Search Engine

www.completeplanet.com - BrightPlanet - Searches over 70,000 databases

www.closerlooksearch.com - Closer Look Search - Example of a vertical search engine

http://hakia.com - Example of semantic Web searching

http://mednar.com/mednar/ - Mednar

http://www.wolframalpha.com - Wolfram Alpha - Computational knowledge engine

4.  Specialized Databases:

www.findlaw.com - information on federal and state laws, lawsuits, etc.

www.eric.ed.gov - Digital library of education research and information

http://worldwidescience.org - "The global science gateway". Available now in 9 languages.

www.science.gov - "Authoritative U.S. government science information"

www.scienceresearch.com - A free Web portal to science journals and science databases

www.archive.org/web/web.php - Wayback Machine - archive of websites

www.usa.gov - The official Web portal to the U. S. government

www.loc.gov - Library of Congress

www.ncbi.nlm.nih.gov/pubmed/ - PubMed: U.S. National Library of Medicine portal to government-funded medical research

5. How to Keep Up-to-date:

http://searchenginewatch.com

www.marylaine.com/neatnew.html - Last edition posted August 31, 2012.

http://searchengineland.com

6. Weblogs:

Invisible Web Weblog - http://invisibleweblog.blogspot.com/
Maintained by Yazdan Mansourian.

7. Foreign language sources:

http://europeana.eu/ - A digital European library available in 25 languages.

http://c.asselin.free.fr/french/invisible_web.htm - "Web invisible, web cache, web profound," a French tutorial on the Invisible Web.

Back to top

Last updated: September 2012