Difference between revisions of "Starwars.yahoo.com"
(using {{saved}} categorization) |
|||
Line 4: | Line 4: | ||
| description = | | description = | ||
| URL = http://starwars.yahoo.com | | URL = http://starwars.yahoo.com | ||
| | | project_status = {{offline}} | ||
| | | archiving_saved = {{saved}} | ||
}} | }} | ||
Revision as of 22:10, 20 December 2010
STARWARS.YAHOO.COM | |
URL | http://starwars.yahoo.com |
Status | Offline |
Archiving status | Unknown |
Archiving type | Unknown |
IRC channel | #archiveteam-bs (on hackint) |
STARWARS.YAHOO.COM was a Star Wars themed user site, containing forums, user pages, and general movie information. Announced as a beta in October of 2007, it successfully suckered many users into posting, uploading, and sharing information on it before it was summarily shut off by Yahoo with a 30 day notice in December of 2009. On Dec 15, 2009, Yahoo shut the site down completely and redirected all queries to starwars.com.
Archive Team sprung into action and saved 99.9% of /users/, /forums/, /links/, and a smaller percentage of the other content on the site. (Most of the general star wars information was duplicated on starwars.com anyway - we focused our efforts on user-generated content.)
Problems encountered:
- Yahoo issues an error 999 after about 30 minutes of fetching from a certain IP. We used two approaches to get around this.
- TOR (slow as molasses, but worked) - collected using httrack
- multiple IPs (fast, but needs large IP resources) - collected using wget
The tarballs in the archive reflect both archiving methods:
-rw-r--r-- 1 root root 228855239 Dec 15 13:35 starwars.yahoo.com-goekesmi-raw.tar.bz2 -rw-r--r-- 1 root root 36529217 Dec 20 15:53 starwars.yahoo.com-tor.tar.bz2
This archive of the collected remnants is located here.