Difference between revisions of "User:Emijrp"

From Archiveteam
Jump to navigation Jump to search
m
 
(48 intermediate revisions by the same user not shown)
Line 1: Line 1:
<span style="float: right;font-size: 2em;">·<u>L</u>·</span>
<center><div style="background-color: lightblue;width: 85%;">Around the year 2150, '''petabytes''' of currently generated content, if preserved, will enter in the public domain<br/>and will be freely used in projects like Wikipedia.</div></center>
I am the same guy of Wikipedia (http://en.wikipedia.org/wiki/User:Emijrp). You can contact me if you have questions related to wikis.


== Jamendo ==
[[File:Archive-all-the-things-thumb.jpg|right]]
* Downloading every single album. There are about 1.5 TB of music. Downloaded from ID 0 to 13004. Also seeding in BitTorrent from 0 to 2999. I am downloading in OGG format, it is free and better than MP3.
I am the same guy of [[Wikipedia]] ([https://en.wikipedia.org/wiki/User:Emijrp User:Emijrp]). You can contact me (emijrp{{@}}gmail.com) if you have questions related to [[wikis]] or libre content.


== Wikis ==
An English-centric archival effort is a biased one. Surf this: http://www.dmoz.org/World/
I like free knowledge. I'm going to get a copy.
 
* Wikipedia predecessors
:'''''[https://archive.org/details/wiki-archiveteamorg Download a backup of Archive Team Wiki from here].'''''
** Nupedia
 
*** Trying to save the ~20 published articles in en.wikisource.org
__TOC__
** GNUPedia
== Projects ==
*** Only 3 articles where sent to the mailing list
<!-- [[File:Oh shit archive team is here.png|right|]] -->
* Wiki[mp]edia (see http://en.wikipedia.org/wiki/User:Emijrp/Wikipedia_Archive):
[[File:Fukkensaved.jpg|right|400px]]
** Only the 7z files pages-meta-history.xml.7z (the most important ones, they contain the text and the metadata for every revision): http://download.wikimedia.org/backup-index.html
* [[Jamendo]] holds about 2 TB of music. Jason Scott added [https://archive.org/details/jamendo-albums 59,000 albums] to Internet Archive using [https://github.com/emijrp/jamendo-downloader my download script]. That was in 2012, a new scan would be nice.
*** Done! 2010-08 (the most recent English Wikipedia dump is from 2010-01-30)
* [[LibreTeam]]
** Static HTML: http://static.wikipedia.org/
* [[ProHosting]]
* Wikia wikis: http://wiki-stats.wikia.com/
* [[WikiTeam]], the Archive Team subcommittee for wikis
** Downloading...
** [[Nupedia]] (save the ~20 published articles here)
* More wikis:
** [[GNUPedia]] (Only 3 articles where sent to the mailing list. Archived links in the article.)
** Enciclopedia Libre Universal en Español: http://enciclopedia.us.es
** [[Wikipedia]] (see [https://en.wikipedia.org/wiki/User:Emijrp/Wikipedia_Archive User:Emijrp/Wikipedia Archive]):
*** Saved all images (2GB) 2010-08-14
** [[Wikia]] wikis: http://wiki-stats.wikia.com/
** Wikanda: http://www.wikanda.es
** [[Enciclopedia Libre Universal en Español]] [http://enciclopedia.us.es]. Saved all images (2GB) 2010-08-14
*** Huelvapedia images, done!
** [[Wikanda]]: http://www.wikanda.es Done!
*** Cádizpedia images, done!
** [[Citizendium]] [http://en.citizendium.org/wiki/CZ:Downloads]
** Wikiextremadura: http://www.wikiextremadura.org offline : (
* [[OpenStreetMap]] [http://wiki.openstreetmap.org/wiki/Database_dump]
** LeonWiki: offline
* [[OmegaWiki]] [http://www.omegawiki.org/Development]. Saved! 2010-10-31
* Citizendium: http://en.citizendium.org/wiki/CZ:Downloads
* [[GeoNames]] [http://download.geonames.org/export/]
** Saved! It was easy, only 100 MB
 
* OpenStreetMap: http://wiki.openstreetmap.org/wiki/Database_dump
== How to upload stuff to Internet Archive ==
* Archiveteam wiki (LOL): paste the content in [[/Archiveteam]] into [[Special:Export]]. It generates an xml file.
 
To upload stuff to [[Internet Archive]] you can use the [https://archive.org/create web interface], but in this tutorial we will learn to use the GNU/Linux console and the [https://pypi.python.org/pypi/internetarchive internetarchive] Python module. You need a Linux distro, Python, pip and an account in Internet Archive.
 
Configuration:
 
* sudo apt-get install python
* sudo easy_install pip
* sudo pip install internetarchive
* ia configure
 
Funny stuff. In this example we will backup [[GeoNames]] project:
 
* wget -r -np -l 1 -A zip,txt http://download.geonames.org/export/dump/
* ia upload GeoNames-20151022 download.geonames.org/export/dump/*.{zip,txt}
 
Result:
 
* uploading AD.zip: [################################] 1/1 - 00:00:00
* uploading AE.zip: [################################] 1/1 - 00:00:00
* uploading AF.zip: [################################] 5/5 - 00:00:00
* etc...
 
See [https://archive.org/details/GeoNames-20151022 GeoNames-20151022]. When the upload finishes, you can improve the metadata using the web interface. Or add the metadata in the upload process with --metadata="title:foo" --metadata="blah:arg"
 
== Maintenance ==
 
Dealing with spam in this wiki:
* [[MediaWiki:Spam-blacklist]] and [[MediaWiki:Spam-whitelist]]
* [[MediaWiki:Titleblacklist]] and [[MediaWiki:Titlewhitelist]] (examples http://en.wikipedia.org/wiki/MediaWiki:Titleblacklist)
 
Other:
* [[Template:Infobox project]]
* [[Template:Navigation box]]
* [[Special:Newpages]]
* [[Special:Random/User]]


== Tip ==
[[File:Backupyourdata.gif|center]]
[[File:Backupyourdata.gif|center]]

Latest revision as of 14:37, 22 October 2015

Around the year 2150, petabytes of currently generated content, if preserved, will enter in the public domain
and will be freely used in projects like Wikipedia.
Archive-all-the-things-thumb.jpg

I am the same guy of Wikipedia (User:Emijrp). You can contact me (emijrpAt sign.pnggmail.com) if you have questions related to wikis or libre content.

An English-centric archival effort is a biased one. Surf this: http://www.dmoz.org/World/

Download a backup of Archive Team Wiki from here.

Projects

Fukkensaved.jpg

How to upload stuff to Internet Archive

To upload stuff to Internet Archive you can use the web interface, but in this tutorial we will learn to use the GNU/Linux console and the internetarchive Python module. You need a Linux distro, Python, pip and an account in Internet Archive.

Configuration:

  • sudo apt-get install python
  • sudo easy_install pip
  • sudo pip install internetarchive
  • ia configure

Funny stuff. In this example we will backup GeoNames project:

Result:

  • uploading AD.zip: [################################] 1/1 - 00:00:00
  • uploading AE.zip: [################################] 1/1 - 00:00:00
  • uploading AF.zip: [################################] 5/5 - 00:00:00
  • etc...

See GeoNames-20151022. When the upload finishes, you can improve the metadata using the web interface. Or add the metadata in the upload process with --metadata="title:foo" --metadata="blah:arg"

Maintenance

Dealing with spam in this wiki:

Other:

Backupyourdata.gif