FTP

From Archiveteam
Revision as of 18:02, 13 June 2014 by Midas (talk | contribs)
Jump to navigation Jump to search
FTP
Threeplaces.jpg
Status Online!
Archiving status Not saved yet
Archiving type Unknown
Project source https://github.com/ArchiveTeam/ftp-nab
IRC channel #effteepee (on hackint)

Archiving a whole public FTP host/mirror is easy:

SketchCow> I use wget -r -l 0 -np -nc ftp://ftp.underscorporn.com
tar cvf 2014.01.ftp.underscorporn.com.tar ftp.underscorporn.com
tar tvf 2014.01.ftp.underscorporn.com.tar > 2014.01.ftp.underscorporn.com.tar.txt

OR, use this handydandy collection of commands with imput. Made by SN4T14

#!/bin/bash
echo "Enter the FTP server you want to grab."
read FTP
wget -r -l 0 -np -nc ftp://"$FTP"
       tar cvf $(date +%Y).$(date +%m)."$FTP".tar "$FTP"
       tar tvf $(date +%Y).$(date +%m)."$FTP".tar > $(date +%Y).$(date +%m)."$FTP".tar.txt


Now zip/tar it up and send to the spacious Internet Archive![1] (If you're short on space: tar --remove-files deletes the files shortly after adding them to the tar, not waiting for it to be complete, unlike zip -rm.)

The Project

Who is grabbing what?
Midas ftp.tu-chemnitz.de
Midas ftp.uni-muenster.de
Midas gatekeeper.dec.com
Midas ftp.uni-erlangen.de
Midas ftp.warwick.ac.uk

Uni FTP's are massive, currently only grabbing DEC and Sweex.

External Links