Data Age
A permanent archive of the Web--some 200 million sites' worth
By Rena Marie Pacella Posted 10.31.2011 at 11:28 am 1 Comment

Amazing Databases: The Wayback Machine Wikimedia Commons

The purpose of the Wayback Machine is to copy and store the Internet. Since the San Francisco–based nonprofit Internet Archive created the database 15 years ago, browsing software called crawlers have captured 180 billion Web page snapshots from more than 200 million sites.

Now, at four petabytes, with another 35 to 40 terabytes added every month, the Wayback Machine is the largest accessible Web archive in existence. Plug in the URL of, say, a shuttered blog, and you’ll get a timeline of crawl-dates, most of which link to functional versions of the website on that day. The Wayback Machine is free, so any curious browser can use the data for historical research or to study the evolution of the Web. Researchers at the Library of Congress, for example, used the Wayback Machine to assemble a gallery of websites as they appeared on September 11th, 2001, and in the following three months.

Check out the other nine most amazing databases in the world here.

1 Comment

Link to this comment
eregorn8
10/31/11 at 7:46 pm

For those of you wanting a link:

http://www.archive.org/web/web.php

Try typing "www.google.com" and feel the memories.



June 2013: American Energy Independence

Five amazing, clean technologies that will set us free, in this month's energy-focused issue. Also: how to build a better bomb detector, the robotic toys that are raising your children, a human catapult, the world's smallest arcade, and much more.


Online Content Director: Suzanne LaBarre | Email
Senior Editor: Paul Adams | Email
Associate Editor: Dan Nosowitz | Email
Assistant Editor: Colin Lecher | Email
Assistant Editor: Rose Pastore | Email

Contributing Writers:
Rebecca Boyle | Email
Kelsey D. Atherton | Email
Francie Diep | Email
Shaunacy Ferro | Email

circ-top-header.gif
circ-cover.gif
bmxmag-ps