Difference between revisions of "FTP"
Jump to navigation
Jump to search
(Fixed whitespace and script.) |
|||
Line 15: | Line 15: | ||
OR, use this handy dandy function to put in your .bashrc file, you can also remove the first and last line to turn it into a fancy bash script. Made by SN4T14 | OR, use this handy dandy function to put in your .bashrc file, you can also remove the first and last line to turn it into a fancy bash script. Made by SN4T14 | ||
ftp-grab(){ | |||
target="$1" | |||
wget -r -l 0 -np -nc "$target" | |||
if [[ "$target" =~ ^ftp://.*$ ]] | |||
then | |||
target="$(echo "$target" | cut -d '/' -f 3)" | |||
echo "ftp" | |||
echo "$target" | |||
fi | |||
tar cvf $(date +%Y).$(date +%m)."$target".tar "$target" | |||
tar tvf $(date +%Y).$(date +%m)."$target".tar > $(date +%Y).$(date +%m)."$target".tar.txt | |||
} | |||
Revision as of 19:16, 13 June 2014
FTP | |
Status | Online! |
Archiving status | Not saved yet |
Archiving type | Unknown |
Project source | https://github.com/ArchiveTeam/ftp-nab |
IRC channel | #effteepee (on hackint) |
Archiving a whole public FTP host/mirror is easy:
SketchCow> I use wget -r -l 0 -np -nc ftp://ftp.underscorporn.com tar cvf 2014.01.ftp.underscorporn.com.tar ftp.underscorporn.com tar tvf 2014.01.ftp.underscorporn.com.tar > 2014.01.ftp.underscorporn.com.tar.txt
OR, use this handy dandy function to put in your .bashrc file, you can also remove the first and last line to turn it into a fancy bash script. Made by SN4T14
ftp-grab(){ target="$1" wget -r -l 0 -np -nc "$target" if "$target" =~ ^ftp://.*$ then target="$(echo "$target" | cut -d '/' -f 3)" echo "ftp" echo "$target" fi tar cvf $(date +%Y).$(date +%m)."$target".tar "$target" tar tvf $(date +%Y).$(date +%m)."$target".tar > $(date +%Y).$(date +%m)."$target".tar.txt }
Now zip/tar it up and send to the spacious Internet Archive![1] (If you're short on space: tar --remove-files
deletes the files shortly after adding them to the tar, not waiting for it to be complete, unlike zip -rm
.)
The Project
- We're currently listing all FTP sites on the internet to download them all.
- We're auding a list of some select FTP sites manually: https://www.piratepad.ca/p/old-ftp-list
Midas | ftp.tu-chemnitz.de |
Midas | ftp.uni-muenster.de |
Midas | gatekeeper.dec.com |
Midas | ftp.uni-erlangen.de |
Midas | ftp.warwick.ac.uk |
Uni FTP's are massive, currently only grabbing DEC and Sweex.