Difference between revisions of "Google Groups Files"
(→Status) |
(→Status) |
||
Line 12: | Line 12: | ||
== Status == | == Status == | ||
'''We need help with downloading, run the script with the "download" parameter''' | |||
<br> | |||
<br> | |||
2011-06-04: | 2011-06-04: | ||
Line 21: | Line 25: | ||
directories: done: 76080<br> | directories: done: 76080<br> | ||
groups: done: 163749 | groups: done: 163749 | ||
2011-06-16: | |||
directories: NEW: 80942, PROCESSING: 7, DONE_DIR: 81644<br> | |||
groups: NEW: 880230, PROCESSING: 97, ERROR: 5825, ADULT: 3893, DONE_GRP: 172148 | |||
== Script == | == Script == |
Revision as of 17:57, 16 June 2011
Google is challenging AT again...
This notice appears on Google Groups pages:
Zipped versions of the pages and files associated with this group will be available for download until August 31, 2011. After this date, this feature and the zip file downloads will be turned off permanently.
A script is available that searches Google Groups directories and downloads the ZIP files of individual groups. The script uses a Google App Engine hosted app for coordination.
Status
We need help with downloading, run the script with the "download" parameter
2011-06-04:
directories: new: 59926, done: 25585
groups: new 552075, done: 70804
2011-06-14:
directories: done: 76080
groups: done: 163749
2011-06-16:
directories: NEW: 80942, PROCESSING: 7, DONE_DIR: 81644
groups: NEW: 880230, PROCESSING: 97, ERROR: 5825, ADULT: 3893, DONE_GRP: 172148
Script
Requirements
(ba)sh, wget, grep, curl
Usage
- Normal operation
./ggroups_zipdl.sh
- Discover only (no downloads to store)
./ggroups_zipdl.sh discover
- Download only (no discovery of new groups)
./ggroups_zipdl.sh download
Issues
-