Difference between revisions of "User:Emijrp"

From Archiveteam
Jump to navigation Jump to search
 
(7 intermediate revisions by the same user not shown)
Line 2: Line 2:


[[File:Archive-all-the-things-thumb.jpg|right]]
[[File:Archive-all-the-things-thumb.jpg|right]]
I am the same guy of [[Wikipedia]] (http://en.wikipedia.org/wiki/User:Emijrp). You can contact me if you have questions related to [[wikis]] or libre content, reach me at emijrp{{@}}gmail.com.
I am the same guy of [[Wikipedia]] ([https://en.wikipedia.org/wiki/User:Emijrp User:Emijrp]). You can contact me (emijrp{{@}}gmail.com) if you have questions related to [[wikis]] or libre content.
 
* [[Template:Infobox project]]
* [[Special:Newpages]]


An English-centric archival effort is a biased one. Surf this: http://www.dmoz.org/World/
An English-centric archival effort is a biased one. Surf this: http://www.dmoz.org/World/


:'''''[https://code.google.com/p/wikiteam/downloads/list?can=2&q=archiveteam Download a backup of Archive Team Wiki from here].'''''
:'''''[https://archive.org/details/wiki-archiveteamorg Download a backup of Archive Team Wiki from here].'''''


__TOC__
__TOC__
== [[Jamendo]] ==
== Projects ==
:''Jason Scott is uploading [http://www.archive.org/details/jamendo-albums all albums to Internet Archive]. Mission accomplished?''
<!-- [[File:Oh shit archive team is here.png|right|]] -->
* Downloading every single album. There are about 2 TB of music. Downloaded from ID 0 to 63416. <s>Also seeding in BitTorrent from 0 to 2999</s>. I am downloading in OGG format, it is free and better than MP3.
[[File:Fukkensaved.jpg|right|400px]]
 
* [[Jamendo]] holds about 2 TB of music. Jason Scott added [https://archive.org/details/jamendo-albums 59,000 albums] to Internet Archive using [https://github.com/emijrp/jamendo-downloader my download script]. That was in 2012, a new scan would be nice.
== [[Wikis]] (see ''[[Wikiteam]]'') ==
* [[LibreTeam]]
I like free knowledge. I'm going to get a copy.
* [[ProHosting]]
* [[Wikipedia]] predecessors
* [[WikiTeam]], the Archive Team subcommittee for wikis
** [[Nupedia]] (save the ~20 published articles here)
** [[Nupedia]] (save the ~20 published articles here)
** [[GNUPedia]] (Only 3 articles where sent to the mailing list. Archived links in the article.)
** [[GNUPedia]] (Only 3 articles where sent to the mailing list. Archived links in the article.)
[[File:Oh shit archive team is here.png|right|]]
** [[Wikipedia]] (see [https://en.wikipedia.org/wiki/User:Emijrp/Wikipedia_Archive User:Emijrp/Wikipedia Archive]):
* Wiki[mp]edia (see http://en.wikipedia.org/wiki/User:Emijrp/Wikipedia_Archive):
** [[Wikia]] wikis: http://wiki-stats.wikia.com/
** Only the 7z files pages-meta-history.xml.7z (the most important ones, they contain the text and the metadata for every revision): http://download.wikimedia.org/backup-index.html
** [[Enciclopedia Libre Universal en Español]] [http://enciclopedia.us.es]. Saved all images (2GB) 2010-08-14
*** Done! 2010-08 (the most recent English Wikipedia dump is from 2010-01-30)
** <s>Static HTML: http://static.wikipedia.org/</s> very out-of-date and all the relevant info is on the 7z files above
* [[Wikia]] wikis: http://wiki-stats.wikia.com/
** Downloading...
* More wikis:
** [[Enciclopedia Libre Universal en Español]]: http://enciclopedia.us.es
*** Saved all images (2GB) 2010-08-14
** [[Wikanda]]: http://www.wikanda.es Done!
** [[Wikanda]]: http://www.wikanda.es Done!
** Wikiextremadura: http://www.wikiextremadura.org offline : (
** [[Citizendium]] [http://en.citizendium.org/wiki/CZ:Downloads]
** LeonWiki: offline
* [[OpenStreetMap]] [http://wiki.openstreetmap.org/wiki/Database_dump]
* [[Citizendium]]: http://en.citizendium.org/wiki/CZ:Downloads
* [[OmegaWiki]] [http://www.omegawiki.org/Development]. Saved! 2010-10-31
* [[OpenStreetMap]]: http://wiki.openstreetmap.org/wiki/Database_dump
* [[GeoNames]] [http://download.geonames.org/export/]
* [[OmegaWiki]]: http://www.omegawiki.org/Development
 
** Saved! 2010-10-31
== How to upload stuff to Internet Archive ==
* <s>[[Archive Team]] wiki (LOL): paste the content from [[/Archiveteam]] into [[Special:Export]]. It generates a XML file.</s> [http://code.google.com/p/wikiteam/downloads/list?can=2&q=archiveteam dump in google code]
 
* [[GeoNames]] http://download.geonames.org/export/
To upload stuff to [[Internet Archive]] you can use the [https://archive.org/create web interface], but in this tutorial we will learn to use the GNU/Linux console and the [https://pypi.python.org/pypi/internetarchive internetarchive] Python module. You need a Linux distro, Python, pip and an account in Internet Archive.
** Done 2010-11-16
 
Configuration:
 
* sudo apt-get install python
* sudo easy_install pip
* sudo pip install internetarchive
* ia configure


=== Domas visits logs ===
Funny stuff. In this example we will backup [[GeoNames]] project:
[[File:Fukkensaved.jpg|right|400px]]
 
By Lars:
* wget -r -np -l 1 -A zip,txt http://download.geonames.org/export/dump/
* From December 2007 to September 2009: http://www.archive.org/details/wikipedia_visitor_stats_200712
* ia upload GeoNames-20151022 download.geonames.org/export/dump/*.{zip,txt}
* October 2009: http://www.archive.org/details/wikipedia_visitor_stats_200910
 
Uploading:
Result:
* November 2009


== [[LibreTeam]] ==
* uploading AD.zip: [################################] 1/1 - 00:00:00
In progress...
* uploading AE.zip: [################################] 1/1 - 00:00:00
* uploading AF.zip: [################################] 5/5 - 00:00:00
* etc...


== Spam fighting ==
See [https://archive.org/details/GeoNames-20151022 GeoNames-20151022]. When the upload finishes, you can improve the metadata using the web interface. Or add the metadata in the upload process with --metadata="title:foo" --metadata="blah:arg"
* Dealing with spam in this wiki:
** [[MediaWiki:Spam-blacklist]] and [[MediaWiki:Spam-whitelist]]
** [[MediaWiki:Titleblacklist]] and [[MediaWiki:Titlewhitelist]] (examples http://en.wikipedia.org/wiki/MediaWiki:Titleblacklist)


== Other tasks ==
== Maintenance ==
* [[ProHosting]]


== Tip ==
Dealing with spam in this wiki:
[[File:Backupyourdata.gif|center]]
* [[MediaWiki:Spam-blacklist]] and [[MediaWiki:Spam-whitelist]]
* [[MediaWiki:Titleblacklist]] and [[MediaWiki:Titlewhitelist]] (examples http://en.wikipedia.org/wiki/MediaWiki:Titleblacklist)


== External links ==
Other:
<span style="float: right;font-size: 2em;">·<u>L</u>·</span>
* [[Template:Infobox project]]
* http://wikiindex.org site with a ton of wikis
* [[Template:Navigation box]]
* [[Special:Newpages]]
* [[Special:Random/User]]


{{Navigation box}}
[[File:Backupyourdata.gif|center]]

Latest revision as of 14:37, 22 October 2015

Around the year 2150, petabytes of currently generated content, if preserved, will enter in the public domain
and will be freely used in projects like Wikipedia.
Archive-all-the-things-thumb.jpg

I am the same guy of Wikipedia (User:Emijrp). You can contact me (emijrpAt sign.pnggmail.com) if you have questions related to wikis or libre content.

An English-centric archival effort is a biased one. Surf this: http://www.dmoz.org/World/

Download a backup of Archive Team Wiki from here.

Projects

Fukkensaved.jpg

How to upload stuff to Internet Archive

To upload stuff to Internet Archive you can use the web interface, but in this tutorial we will learn to use the GNU/Linux console and the internetarchive Python module. You need a Linux distro, Python, pip and an account in Internet Archive.

Configuration:

  • sudo apt-get install python
  • sudo easy_install pip
  • sudo pip install internetarchive
  • ia configure

Funny stuff. In this example we will backup GeoNames project:

Result:

  • uploading AD.zip: [################################] 1/1 - 00:00:00
  • uploading AE.zip: [################################] 1/1 - 00:00:00
  • uploading AF.zip: [################################] 5/5 - 00:00:00
  • etc...

See GeoNames-20151022. When the upload finishes, you can improve the metadata using the web interface. Or add the metadata in the upload process with --metadata="title:foo" --metadata="blah:arg"

Maintenance

Dealing with spam in this wiki:

Other:

Backupyourdata.gif