Difference between revisions of "FTP"

From Archiveteam
Jump to navigation Jump to search
Line 13: Line 13:
  tar cvf 2014.01.ftp.underscorporn.com.tar ftp.underscorporn.com
  tar cvf 2014.01.ftp.underscorporn.com.tar ftp.underscorporn.com
  tar tvf 2014.01.ftp.underscorporn.com.tar > 2014.01.ftp.underscorporn.com.tar.txt
  tar tvf 2014.01.ftp.underscorporn.com.tar > 2014.01.ftp.underscorporn.com.tar.txt
OR, use this handydandy collection of commands with imput.
#!/bin/bash
echo "Enter the FTP server you want to grab."
read FTP
wget -r l 0 -np -nc ftp://"$FTP"
        tar cvf $(date +%Y).$(date +%m)."$FTP".tar "$FTP"
        tar tvf $(date +%Y).$(date +%m)."$FTP".tar > $(date +%Y).$(date +%m)."$FTP".tar.txt


Now zip/tar it up and [[Internet_Archive#Uploading_to_archive.org|send to the spacious Internet Archive]]![https://archive.org/details/ftpsites] (If you're short on space: <code>tar --remove-files</code> deletes the files shortly after adding them to the tar, not waiting for it to be complete, unlike <code>zip -rm</code>.)
Now zip/tar it up and [[Internet_Archive#Uploading_to_archive.org|send to the spacious Internet Archive]]![https://archive.org/details/ftpsites] (If you're short on space: <code>tar --remove-files</code> deletes the files shortly after adding them to the tar, not waiting for it to be complete, unlike <code>zip -rm</code>.)

Revision as of 07:17, 13 June 2014

FTP
Threeplaces.jpg
Status Online!
Archiving status Not saved yet
Archiving type Unknown
Project source https://github.com/ArchiveTeam/ftp-nab
IRC channel #effteepee (on hackint)

Archiving a whole public FTP host/mirror is easy:

SketchCow> I use wget -r -l 0 -np -nc ftp://ftp.underscorporn.com
tar cvf 2014.01.ftp.underscorporn.com.tar ftp.underscorporn.com
tar tvf 2014.01.ftp.underscorporn.com.tar > 2014.01.ftp.underscorporn.com.tar.txt

OR, use this handydandy collection of commands with imput.

#!/bin/bash
echo "Enter the FTP server you want to grab."
read FTP
wget -r l 0 -np -nc ftp://"$FTP"
       tar cvf $(date +%Y).$(date +%m)."$FTP".tar "$FTP"
       tar tvf $(date +%Y).$(date +%m)."$FTP".tar > $(date +%Y).$(date +%m)."$FTP".tar.txt


Now zip/tar it up and send to the spacious Internet Archive![1] (If you're short on space: tar --remove-files deletes the files shortly after adding them to the tar, not waiting for it to be complete, unlike zip -rm.)

The Project

Who is grabbing what?
Midas ftp.tu-chemnitz.de
Midas ftp.uni-muenster.de
Midas gatekeeper.dec.com
Midas ftp.uni-erlangen.de
Midas ftp.warwick.ac.uk

Uni FTP's are massive, currently only grabbing DEC and Sweex.

External Links