Difference between revisions of "Ispygames"

From Archiveteam
Jump to navigation Jump to search
(Add link to IA collection (maybe this isn't all of it? seems a bit small file size wise?))
 
(58 intermediate revisions by 16 users not shown)
Line 1: Line 1:
{| width=300px style="border: 1px solid #aaa; background-color: #f9f9f9; color: black; margin: 0.5em 0 0.5em 1em; padding: 0.2em; font-size: 90%;clear: right; float: right;"
{{Infobox project
|-
| title = Gamespy, IGN, 1up, ugo
| colspan=2 align=center | <big>'''{{{title|Gamespy, IGN, 1up, ugo}}}'''</big>
| image = gamespy.jpg
|-
| URL = {{URL|http://www.gamespy.com}} & many others
| colspan=2 align=center | [[File:{{{logo|Dummy.png}}}|100px|{{PAGENAME}} logo]]
| project_status = {{closing}}
|-
| archiving_status = {{partiallysaved}}
| colspan=2 align=center | [[File:{{{image|gamespy.jpg}}}|280px|{{{description|}}}]]<br/>{{{description|}}}
| irc = ispygames
|-
| irc_network = EFnet
| width=125px | '''URL''' || {{{URL|{{{url|http://www.gamespy.com & many others}}}}}}
| irc_abandoned = true
|-
| data = {{IA collection|archiveteam_ignsites}} <br> {{Job|35fcc4zofjl5kg52fkbcskgus}}
| width=125px | '''Project status''' || {{{project_status|{{Closing}}}}}
}}
|-
| width=125px | '''Archiving status''' || {{{archiving_status|{{inprogress}}}}}
|-
| width=125px | '''Project source''' || {{{source|{{Unknown}}}}}
|-
| width=125px | '''Project tracker''' || {{{tracker|{{Unknown}}}}}
|-
| width=125px | '''IRC channel''' || <span class="plainlinks">[http://chat.efnet.org:9090/?nick=&channels=%23{{{irc|ispygames}}}&Login=Login #{{{irc|ispygames}}}]</span>
|}<noinclude>


== The News ==
== The News ==


[http://www.polygon.com/2013/2/21/4014196/ign-layoffs-1up-ugo-and-gamespy-shutting-down IGN hit with layoffs, 1UP, UGO and GameSpy shutting down]<br />
[http://www.polygon.com/2013/2/21/4014196/ign-layoffs-1up-ugo-and-gamespy-shutting-down IGN hit with layoffs, 1UP, UGO and GameSpy shutting down]<br />
[http://www.examiner.com/article/1up-ugo-and-gamespy-to-be-shut-down 1UP, UGO and GameSpy to be shut down]
[http://www.examiner.com/article/1up-ugo-and-gamespy-to-be-shut-down 1UP, UGO and GameSpy to be shut down]<br />
 
[http://pc.gamespy.com/articles/122/1227460p1.html Goodbye, And Thank You From The GameSpy Team]
== The Problems ==
== The Problems ==


Line 40: Line 31:


* Save the sites and related content
* Save the sites and related content
* Backup the twitter feeds for any associated accounts. [http://www.allmytweets.net/ All my tweets] just takes a username and returns the max tweets possible.
* Backup the Twitter feeds for any associated accounts. [http://www.allmytweets.net/ All my tweets] just takes a username and returns the max tweets possible.




Line 71: Line 62:


== IGN domains ==
== IGN domains ==
=== In progress ===
* http://aavault.ign.com - grabbed, checking for completeness
* http://aavault.ign.com - grabbed, checking for completeness
* http://autoassaultvault.ign.com/ - grabbed, checking for completeness
* http://autoassaultvault.ign.com/ - grabbed, checking for completeness
Line 105: Line 98:
* http://www.blockbuster.ign.com - already dead
* http://www.blockbuster.ign.com - already dead
* http://kaneandlynch.ign.com/ - flash based
* http://kaneandlynch.ign.com/ - flash based
* http://wishvault.ign.com - siliconvalleypark grabbing
* http://wishvault.ign.com - siliconvalleypark grabbing, Smiley done
* http://witchervault.ign.com - siliconvalleypark - grabbed
* http://witchervault.ign.com - siliconvalleypark, Smiley - grabbed, done
* http://www.supersmashbros.ign.com - Smiley grabbing
* http://www.supersmashbros.ign.com - Smiley grabbing
* http://www.championshipgamingseries.com - Smiley grabbing
* http://www.championshipgamingseries.com - Smiley grabbing
Line 143: Line 136:
* http://gbartone.dev.m.uk.ign.com - not found
* http://gbartone.dev.m.uk.ign.com - not found
* http://grandtheftautohood.ign.com -> grandtheftauto.ign.com
* http://grandtheftautohood.ign.com -> grandtheftauto.ign.com
* http://grandtheftauto.ign.com - Smiley
* http://grandtheftauto.ign.com - Smiley, done
* http://gtahood.ign.com -> grandtheftauto.ign.com
* http://gtahood.ign.com -> grandtheftauto.ign.com
* http://gta.ign.com - Smiley, done
* http://gta.ign.com - Smiley, done
Line 180: Line 173:
* http://uk.video.ign.com - Smiley grabbing -> broken by redirect
* http://uk.video.ign.com - Smiley grabbing -> broken by redirect
* http://niboppub.ign.com - Smiley, done
* http://niboppub.ign.com - Smiley, done
* http://nwvault.ign.com - Smiley
* http://nwvault.ign.com - Smiley, done
* http://m.uk.ign.com - Smiley
* http://m.uk.ign.com - Smiley
* http://musichub.ign.com - Smiley, done
* http://musichub.ign.com - Smiley, done
Line 192: Line 185:
* http://sbvault.ign.com - Smiley, dead, done
* http://sbvault.ign.com - Smiley, dead, done
* http://starcraft2.ign.com - Smiley done
* http://starcraft2.ign.com - Smiley done
 
* http://opt-out.emailpreferences.ign.com -> mail.ign.com, Smiley, done
* http://overlord.ign.com - Smiley, done
* http://pawong.dev.www.ign.com - Smiley, auth failed
* http://planetelderscrolls.ign.com - Smiley, done
* http://play.ign.com -> gamespyarcade.com Smiley, done
* http://gamespyarcade.com - Smiley, done
* http://podcast.ign.com -> ign.com/index/podcasts.html, Smiley, done
* http://podcasts.ign.com -> ign.com/index/podcasts.html, Smiley, done
* http://primeblog.ign.com - Smiley, done
* http://promotions.ign.com - Smiley, done
* http://promotools.ign.com - Smiley
* http://publish.ign.com - Smiley, done
* http://rift.ign.com - Smiley, done
* http://rmcadams.dev.m.ca.ign.com - Smiley, auth failed
* http://rmcadams.dev.m.ign.com - Smiley, auth failed
* http://rmcadams.dev.www.ign.com - Smiley, auth failed
* http://rsullivan.dev.m.ca.ign.com - Smiley, auth failed
* http://rsullivan.dev.m.ign.com - Smiley, auth failed
* http://rsullivan.dev.www.ign.com - Smiley, auth failed
* http://share.affiliation.com - Smiley, dead
* http://share.ign.com - Smiley, done
* http://shootmania.ign.com -> ign.com/ipl/shootmania, Smiley
* http://s.insiderdownloads.ign.com -> http://login.ign.com/prime/landing - Need IGN login subscriber, Smiley
* http://skate2.ign.com - Smiley, done
* http://smashbros.ign.com -> supersmashbros.ign.com, Smiley, done
* http://supersmashbros.ign.com - Breaks wget
* http://smcnabb.dev.www.ign.com - Smiley, auth failed
* http://sovault.ign.com -> vault.ign.com, Smiley, done
* http://strangleholdcentral.ign.com - Smiley, done
* http://strategyvault.ign.com -> vault.ign.com, Smiley, done
* http://sts.ign.com - Smiley, done
* http://studio.ign.com - Smiley, done
* http://swgvault.ign.com - Smiley
* http://swvault.ign.com - Smiley, done with errors
* http://tabularasavault.ign.com - Smiley, done
* http://tdu.ign.com - Smiley, done, broken
* http://tford.dev.m.ign.com - not found, Smiley
* http://tford.dev.www.ign.com - not found, Smiley
* http://thhe.ign.com - Smiley, done
* http://ticket.ign.com - Smiley, done
* http://tickets.ign.com - Smiley, done
* http://titanquestvault.ign.com - Smiley, done
* http://tjohnson.dev.uk.ign.com - 404, Smiley
* http://touch.ign.com - Smiley, done
* http://tqvault.ign.com -> titanquestvault.ign.com, Smiley, done
* http://trvault.ign.com -> tabularasavault.ign.com, Smiley, done
* http://twoworldsvault.ign.com - Smiley
* http://uovault.ign.com -> http://vault.ign.com/uovault.html, Smiley, done
* http://vanguardvault.ign.com - Smiley, done
* http://warhammervault.ign.com - Smiley, done
* http://wikihub.stg.www.ign.com - 404
* http://wiki.stg.www.ign.com - 404
* http://wishvault.ign.com - Smiley
* http://witchervault.ign.com - Smiley
* http://www.antis.ign.com -> http://entertainment.ign.com/antis.html
* http://www.championshipgamingseries.com - Smiley
* http://www.ipl.ign.com -> http://www.ign.com/ipl/
* http://www.kaneandlynch.ign.com -> kaneandlynch.ign.com, Smiley, done
* http://www.mevault.ign.com - Smiley, done
* http://xboxlive.ign.com -> uk.ign.com/xbox-live


=== Ready to grab ===
=== Ready to grab ===
Line 217: Line 269:
* http://o.mobile.ign.com
* http://o.mobile.ign.com
* http://open.em.ign.com
* http://open.em.ign.com
* http://opt-out.emailpreferences.ign.com
* http://overlord.ign.com
* http://pawong.dev.www.ign.com
* http://planetelderscrolls.ign.com
* http://play.ign.com
* http://podcast.ign.com
* http://podcasts.ign.com
* http://primeblog.ign.com
* http://promotions.ign.com
* http://promotools.ign.com
* http://publish.ign.com
* http://rift.ign.com
* http://rmcadams.dev.m.ca.ign.com
* http://rmcadams.dev.m.ign.com
* http://rmcadams.dev.www.ign.com
* http://rsullivan.dev.m.ca.ign.com
* http://rsullivan.dev.m.ign.com
* http://rsullivan.dev.www.ign.com
* http://share.affiliation.com
* http://share.ign.com
* http://shootmania.ign.com
* http://s.insiderdownloads.ign.com
* http://skate2.ign.com
* http://smashbros.ign.com
* http://smcnabb.dev.www.ign.com
* http://sovault.ign.com
* http://speedtv.ign.com
* http://speedtv.ign.com
* http://sslvpn.ign.com
* http://sslvpn.ign.com
* http://staging-api.ign.com
* http://staging-api.ign.com
* http://store.ign.com
* http://store.ign.com
* http://strangleholdcentral.ign.com
* http://strategyvault.ign.com
* http://sts.ign.com
* http://studio.ign.com
* http://supersmashbros.ign.com
* http://swgvault.ign.com
* http://swvault.ign.com
* http://tabularasavault.ign.com
* http://tdu.ign.com
* http://tford.dev.m.ign.com
* http://tford.dev.www.ign.com
* http://thhe.ign.com
* http://ticket.ign.com
* http://tickets.ign.com
* http://titanquestvault.ign.com
* http://tjohnson.dev.au.ign.com
* http://tjohnson.dev.au.ign.com
* http://tjohnson.dev.ca.ign.com
* http://tjohnson.dev.ca.ign.com
* http://tjohnson.dev.ie.ign.com
* http://tjohnson.dev.ie.ign.com
* http://tjohnson.dev.uk.ign.com
* http://tjohnson.dev.www.ign.com
* http://tjohnson.dev.www.ign.com
* http://top100.ign.com
* http://top100.ign.com
* http://touch.ign.com
* http://tqvault.ign.com
* http://trvault.ign.com
* http://twoworldsvault.ign.com
* http://uovault.ign.com
* http://v3-api.stg.ie.ign.com
* http://v3-api.stg.ie.ign.com
* http://v3-api.stg.m.au.ign.com
* http://v3-api.stg.m.au.ign.com
* http://v3-api.stg.m.ie.ign.com
* http://v3-api.stg.m.ie.ign.com
* http://v3-api.stg.www.ign.com
* http://v3-api.stg.www.ign.com
* http://vanguardvault.ign.com
* http://vgu.stg.www.ign.com
* http://vgu.stg.www.ign.com
* http://viashoka.dev.m.ign.com
* http://viashoka.dev.m.ign.com
Line 285: Line 289:
* http://video.stg.www.ign.com
* http://video.stg.www.ign.com
* http://vnboards.ign.com
* http://vnboards.ign.com
* http://warhammervault.ign.com
 
* http://wikihub.stg.www.ign.com
* http://wiki.stg.www.ign.com
* http://wishvault.ign.com
* http://witchervault.ign.com
* http://www.antis.ign.com
* http://www.championshipgamingseries.com
* http://www.ipl.ign.com
* http://www.kaneandlynch.ign.com
* http://www.mevault.ign.com
* http://www.supersmashbros.ign.com
* http://xboxlive.ign.com


=== These might be asset only hosting sites ===
=== These might be asset only hosting sites ===
Line 380: Line 373:


=== Ready to grab ===
=== Ready to grab ===
* http://planetthemovies.gamespy.com
* http://planetelderscrolls.gamespy.com
* http://sslvpn.gamespy.com
* http://sslvpn.gamespy.com
* http://lanoirepc.d2gstore.gamespy.com


=== In Progress ===
=== In Progress ===


* http://lanoirepc.d2gstore.gamespy.com - Smiley, done
* http://gamespyarcade.com - Smiley, done
* http://planetthemovies.gamespy.com - Smiley, done
* http://planetelderscrolls.gamespy.com - Smiley
* http://planetcnc.gamespy.com - grabbed, checking for completeness
* http://planetcnc.gamespy.com - grabbed, checking for completeness
* http://planetthesims.gamespy.com - grabbed, checking for completeness
* http://planetthesims.gamespy.com - grabbed, checking for completeness
Line 422: Line 415:
* http://www.gamespy.com - grabbing Smiley
* http://www.gamespy.com - grabbing Smiley
* http://bugsubmit.gamespy.com - grabbing Smiley
* http://bugsubmit.gamespy.com - grabbing Smiley
* http://ps3.gamespy.com - Smiley grabbing
* http://ps3.gamespy.com - Smiley, done with 503's at the end.


=== Redirects ===
=== Redirects ===
Line 428: Line 421:
* http://forumplanet.gamespy.com -> ign.com/boards
* http://forumplanet.gamespy.com -> ign.com/boards
* http://forums.gamespy.com -> ign.com/boards/categories/gamespy
* http://forums.gamespy.com -> ign.com/boards/categories/gamespy
* http://planetdeusex.gamespy.com -> gamespy.com (actual site's at planetdeusex.com)
* http://planetelderscrolls.gamespy.com -> planetelderscrolls.ign.com
== 1up.com ==
On 2016-05-24, http://www.1up.com has been thrown into [[ArchiveBot]] with {{Job|35fcc4zofjl5kg52fkbcskgus}}.
{{Navigation box}}

Latest revision as of 21:57, 23 November 2021

Gamespy, IGN, 1up, ugo
Gamespy.jpg
URL http://www.gamespy.com[IAWcite.todayMemWeb] & many others
Status Closing
Archiving status Partially saved
Archiving type Unknown
IRC channel #archiveteam-bs (on hackint)
(formerly #ispygames (on EFnet))
Data[how to use] archiveteam_ignsites
job:35fcc4zofjl5kg52fkbcskgus

The News

IGN hit with layoffs, 1UP, UGO and GameSpy shutting down
1UP, UGO and GameSpy to be shut down
Goodbye, And Thank You From The GameSpy Team

The Problems

  • Once you start digging around these sites you find it to be a mess of inconsistent url schemes and content everywhere.
  • Some files are being hosted on MediaFire.
  • Based on tests the larger and older a site is the more that is missed by a wget crawl due to the url scheme.

What we know

  • We already have a list of almost all the domains involved
  • A clean list with dups and bad domains is already being process and will be posted here when complete.
  • Most of the sites are not that big, but a few are huge.

The plan

  • Save the sites and related content
  • Backup the Twitter feeds for any associated accounts. All my tweets just takes a username and returns the max tweets possible.


wget test command

This if for the gamespy sites.

USER_AGENT="Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US)"
SAVE_HOST="http://planetdoom.gamespy.com"
WARC_NAME="warc_name"

wget -e robots=off --mirror --page-requisites \ 
--waitretry 5 --timeout 60 --tries 5 --wait 2 \
--warc-header "operator: Archive Team" --warc-cdx --warc-file="$WARC_NAME" \
-U "$USER_AGENT" "$SAVE_HOST" \
--span-hosts --domains=$SAVE_HOST,pcmedia.gamespy.com,pnmedia.gamespy.com,pspmedia.gamespy.com,oystatic.ignimgs.com

Try this for the ign, ugo sites.

USER_AGENT="Mozilla/5.0 (Windows; U; MSIE 9.0; Windows NT 9.0; en-US)"
SAVE_HOST="http://ve3d.ign.com"
WARC_NAME="warc_name"

wget -e robots=off --mirror --page-requisites \ 
--waitretry 5 --timeout 60 --tries 5 --wait 2 \
--warc-header "operator: Archive Team" --warc-cdx --warc-file="$WARC_NAME" \
-U "$USER_AGENT" "$SAVE_HOST"

IGN domains

In progress

Ready to grab


untested


These might be asset only hosting sites

Redirects

Gamespy Domains

Ready to grab

In Progress

Redirects

1up.com

On 2016-05-24, http://www.1up.com has been thrown into ArchiveBot with job:35fcc4zofjl5kg52fkbcskgus.