|Archiving status||In progress...|
|IRC channel||(on EFnet)|
EVERYTHING2.COM is a kind of proto-wiki, dating from 1999. Never as popular as wikipedia, it still has about 2 million pages, many of which show up nowhere else in the internet.
Since everything2.com is both nonprofit, and shows no signs of shutting down in the near future, I limited wget to one process, and one page a second. Since I started on December 21st, I should be at the two million mark by January 13th. As of 1809h on the 22nd, I'm at node 71000.
02010/12/31 0725h: node 920964
Since everything2.com URLs are of the form http://everything2.com/index.pl?node_id=NUMBER, it's fairly easy to increment NUMBER, and thus download everything on the site without having to follow links.