Difference between revisions of "WikiTeam"

From Archiveteam
Jump to navigation Jump to search
m
Line 1: Line 1:
<center>'''We save wikis, from Wikipedia to tiniest wikis'''</center>
<center>'''We save wikis, from Wikipedia to tiniest wikis'''<br/>[http://code.google.com/p/wikiteam/downloads/list?can=1 +50 wikis saved to date]</center>
{{TOCright}}
{{TOCright}}
A '''wiki''' is a website that allows the creation and editing of any number of interlinked web pages, generally used to store information on a specific subject or subjects. This is done with a day-to-day web browser using a simplified markup language (HTML as an example) or a WYSIWYG (what-you-see-is-what-you-get) text editor.
Examples of huge wikis:
* [[Wikipedia]] - arguably the largest and one of the oldest Wikis on the planet. It offers public backups:
* [[Wikimedia Commons]] - a Wiki of media files available for free usage. It offers public backups:
* [[Wikia]] - a website that allows the creation and hosting of wikis. It offers public backups:
== Tools and source code ==
== Tools and source code ==
Most of the wikis don't offer public backups. How bad!
* [http://code.google.com/p/wikiteam/ WikiTeam Google Code repo] (MediaWiki wikis scrapper, it generates a XML dump, very cool;download images if desired too)
* [http://code.google.com/p/wikiteam/ WikiTeam Google Code repo] (MediaWiki wikis scrapper, it generates a XML dump, very cool;download images if desired too)
* There are many wiki engines, the most famous is MediaWiki. So, the tools must me ready to read data from almost every wiki engine to saved them all.
* There are many wiki engines, the most famous is MediaWiki. So, the tools must me ready to read data from almost every wiki engine to saved them all.
Line 100: Line 108:
* http://blog.shoutwiki.com/
* http://blog.shoutwiki.com/
* http://wikiheaven.blogspot.com/
* http://wikiheaven.blogspot.com/
* [http://s23.org/wikistats/largest_html.php?th=15000&lines=500 List of largest wikis in the world]
* Dump of [http://nostalgia.wikipedia.org/ nostalgia], an ancient version of Wikipedia from 2001, [http://dumps.wikimedia.org/nostalgiawiki dump]
* http://code.google.com/p/wikiteam/downloads/list?can=1 many dumps


{{Navigation box}}
{{Navigation box}}


[[Category:Archive Team]]
[[Category:Archive Team]]

Revision as of 19:56, 7 May 2011

We save wikis, from Wikipedia to tiniest wikis
+50 wikis saved to date

A wiki is a website that allows the creation and editing of any number of interlinked web pages, generally used to store information on a specific subject or subjects. This is done with a day-to-day web browser using a simplified markup language (HTML as an example) or a WYSIWYG (what-you-see-is-what-you-get) text editor.

Examples of huge wikis:

  • Wikipedia - arguably the largest and one of the oldest Wikis on the planet. It offers public backups:
  • Wikimedia Commons - a Wiki of media files available for free usage. It offers public backups:
  • Wikia - a website that allows the creation and hosting of wikis. It offers public backups:

Tools and source code

Most of the wikis don't offer public backups. How bad!


Wiki dumps

Visit the download section in Google Code
Wiki Wiki is online? Dumps available? (official or home-made) Comments/Details Saved by us? Who? Where?
Anarchopedias     -  
Archive Team Wiki Yes Official: no. Home-made: yes - WikiTeam
Bulbapedia Yes Official: no. Home-made: no - dr-spangle is working on it with a self-built PHP downloader
Citizendium Yes Official: daily (no full history). Home-made: yes, April 2011 No image dumps available
EditThis Yes Official: no. Home-made: in progress
enciclopedia.us.es Yes Official: no. Home-made: no Sysop sent me page text sql tables emijrp
Encyclopedia Dramatica No Official: no. Home-made: partial WebEcology Project Article Dump (~9000 Articles)
Most of the Images probably Lost		  
Gentoo wikis Yes Official: no. Home-made: yes WikiTeam
GNUpedia No Official: no. Home-made: no No database. This "wiki encyclopedia" was only HTML pages. Only ~3 articles were sent to the mailing list. After that, the project was closed -
Metapedia Yes Official: ?. Home-made: no - -
Neoseeker Yes Official: ?. Home-made: no - -
Nupedia No Official: ?. Home-made: Yes, saved from IA - -
OmegaWiki Yes Official: daily - -
OpenStreetMap Yes Official: Yes. Home-made: no
OpenSUSE wikis Yes Official: no. Home-made: in progress - -
OSDev Yes Official: weekly - Not yet
Scout wikis
TV Tropes Yes Official: No Unofficial: In progress No dump mechanism, using wget -nc -r -p -l 0 -np -w 45 -E -k -T 10 -nv -x "http://tvtropes.org" DoubleJ
Uncyclomedias
Wikanda Yes Official: no. Home-made: yes - emijrp
Wikia Yes Official: on demand No image dumps available Not yet
WikiFur Yes Official: yes No image dumps available Not yet
WikiHow
Wikimedia Commons Yes Official: periodically No image dumps available Not yet
Wikipedia Yes Official: periodically No image dumps available. English Wikipedia dump uses to be very old Not yet
Wiki-site.com
WikiTravel Yes Official: not yet. Home-made: yes, another of 2010-06-14 - WikiTeam

Tips

Some tips:

  • When downloading Wikipedia/Wikimedia Commons dumps, pages-meta-history.xml.7z and pages-meta-history.xml.bz2 are the same, but 7z use to be smaller (better compress ratio), so use 7z.

Closing/In danger

Offline wikis and wikifarms

elwiki.com

  • 2011
    • wik.is
  • 2010
  • 2009
  • 2008
    • Scribblewiki (wikifarm)

External links

Retrieved from "https://wiki.archiveteam.org/index.php?title=WikiTeam&oldid=5151"