Difference between revisions of "User talk:Meteor"

From Archiveteam
Jump to navigation Jump to search
Line 4: Line 4:


Yes, I've noticed that. I'm going through the URLs and categorize them, as different kinds of URLs need different treatment. [[User:bzc6p|bzc6p]] ([[User_talk:bzc6p|talk]]) 06:26, 2 February 2016 (EST)
Yes, I've noticed that. I'm going through the URLs and categorize them, as different kinds of URLs need different treatment. [[User:bzc6p|bzc6p]] ([[User_talk:bzc6p|talk]]) 06:26, 2 February 2016 (EST)
So the sources you gave contain links to many different kinds of websites, many of them needing different treatment and special care, in order to save them properly and completely (e.g. collecting out links to image pages from Yandex galleries, collecting URLs to full resolution images on image pages on VK.com; checking whether the video sites are all supported by youtube-dl, etc.). Also, once I've compiled the list of the links, I'll need to do test grabs, check them, and if something didn't go well, fix the problems arising from today's "responsive" (i.e. shitload of Javascript that automatic grabbers can't do anything with) websites – and only after everything is fine, can I, partially with the help of ArchiveBot, start the stage of finally downloading everything.
What I want to tell is that I'll make quality archives containing everything that they should, and I'll gladly do this, but preparing this takes some time. I'm halfway through this, and I'll be able to do it, but probably won't have much free time in the near future, so it will take some time, but will definitely be done in the foreseeable future. I hope this is okay for you. [[User:bzc6p|bzc6p]] ([[User_talk:bzc6p|talk]]) 14:37, 13 February 2016 (EST)

Revision as of 19:37, 13 February 2016

Re: Chelyabinsk meteor

Hi. Thanks for collecting the sources, it must have been the more difficult part – compiling a list of download URLs and then bulk downloading them seems to be relatively easy. I'll look into it in the following days and will arrange their upload to the Internet Archive, with the help of Archive Team. bzc6p (talk) 17:08, 27 January 2016 (EST)

Yes, I've noticed that. I'm going through the URLs and categorize them, as different kinds of URLs need different treatment. bzc6p (talk) 06:26, 2 February 2016 (EST)

So the sources you gave contain links to many different kinds of websites, many of them needing different treatment and special care, in order to save them properly and completely (e.g. collecting out links to image pages from Yandex galleries, collecting URLs to full resolution images on image pages on VK.com; checking whether the video sites are all supported by youtube-dl, etc.). Also, once I've compiled the list of the links, I'll need to do test grabs, check them, and if something didn't go well, fix the problems arising from today's "responsive" (i.e. shitload of Javascript that automatic grabbers can't do anything with) websites – and only after everything is fine, can I, partially with the help of ArchiveBot, start the stage of finally downloading everything.

What I want to tell is that I'll make quality archives containing everything that they should, and I'll gladly do this, but preparing this takes some time. I'm halfway through this, and I'll be able to do it, but probably won't have much free time in the near future, so it will take some time, but will definitely be done in the foreseeable future. I hope this is okay for you. bzc6p (talk) 14:37, 13 February 2016 (EST)