Difference between revisions of "Twitch.tv/Vinesauce"

From Archiveteam
Jump to navigation Jump to search
Line 60: Line 60:
The basic procedure:
The basic procedure:


# (future) Go to the check list and look at which chunks of streams haven't been downloaded yet.
# (future) Go to The Checklist and see which chunks of streams haven't been downloaded yet.
# (future) Once you've selected which streams to download, mark ''Downloading'' on the checklist.
# (future) Once you've selected which streams to download, mark ''Downloading'' on the checklist.
# Open up [http://twitch.zazi.bar/ Zazibar's Twitch VOD Download List].
# Open up [http://twitch.zazi.bar/ Zazibar's Twitch VOD Download List].

Revision as of 23:37, 8 August 2014

Vinesauce Twitch.tv Streams
Twitch.tv/Vinesauce logo
Vinesauce com.jpg
URL http://twitch.tv/vinesauce/profile
Status Deadline: 2014-08-27
Archiving status About 1/3 of the way?
Archiving type Unknown
Project source Vinesauce Forums - Archiving Streams
IRC channel #none (on hackint)

The Vinesauce Team has used Twitch.tv since 2013, when they moved over from Livestream. Now, Twitch.tv gives a deadline of three weeks, starting from August 6th, 2014, before they will delete recorded broadcasts older than 14 days.

Most Vinesauce livestreams are not archived elsewhere, have no official highlights (or unofficial ones), and will be irrevocably lost upon deletion.

In response, the Vinesauce community has banded together to archive almost 1,714 streams, totaling a minimum of 500GB. You can help us out by marking a stream for archival on The Checklist, and downloading them using the method described below.

All Vinesauce streams collected will be uploaded to the Internet Archive's "Archiving Virtual Worlds" Collection, serving as a major artifact of contemporary Internet Folklife.

Where the Streams will be Uploaded

  1. For the moment, keep downloading the streams to your hard drives.
  2. When they're ready to be shared, upload them to Mega.co.nz or somewhere else convenient.
  3. (future) Put the download link for each stream on the Checklist.
  4. Once the three week deadline strikes, we will download the streams from the links, and upload them to the Internet Archive's "Archiving Virtual Worlds" Collection for permanent archival.
  5. The archived streams will be viewable using the Internet Archive webplayer, like we did for The 4chan Cup. You can also download the videos in their original format, as necessary.

The Checklist

Vinesauce currently has 1714 videos in it's VOD backlog.

The user Null has made an HTML List of all the links to download.

There will be an actual wiki-editable checklist, so we can see who is downloading what chunk, and who has finished.

Standard Folder Name Format

Each Twitch.tv stream is split into multiple 30-minute parts.

After downloading all the parts from a single stream, group them together into a folder. The folder name should follow this format:

YYYY-MM-DD [streamer] title

For example:

2013-02-12 [Joel] Daikatana

This will make it easier for an automated script to process the videos.

Please don't rename or merge the video files!

  • Doing so will take too much extra time and effort.
  • It also makes it harder for an automated script to figure out which videos we have.
  • The filenames are critical unique metadata IDs!

Just leave the videos as is. The folders are enough.

How to Download Streams

The basic procedure:

  1. (future) Go to The Checklist and see which chunks of streams haven't been downloaded yet.
  2. (future) Once you've selected which streams to download, mark Downloading on the checklist.
  3. Open up Zazibar's Twitch VOD Download List.
  4. Search for Vinesauce.
  5. Click Download on whatever stream you want to download.
  6. Download all the parts of that stream.
    • You might find it useful to use a concurrent download manager, such as DownThemAll or JDownloader (described below)
  7. After all the parts are downloaded, put them into a folder. Follow the Standard Folder Name Format explained above.
  8. Compress the folder into a ZIP archive, using the same folder name.
    • There's no need to use 7zip or RAR, it will take too long. Not to mention FLV videos have already been pre-compressed.
  9. (future) Go to the checklist, add your link to the downloaded stream, and mark it off.

Zazibar's Twitch VOD Download Lister

Zazibar has made a nice Twitch VOD Download List utility. It will list all videos from a Twitch profile (e.g. Vinesauce) and create easy download links for you.

Link: http://twitch.zazi.bar/

DownThemAll - Addon for faster downloads with Firefox

For faster concurrent downloading, use the Firefox Addon DownThemAll

1. Install DownThemAll on Firefox. 2. Open Zazibar's Twitch VOD Download Tool. 3. Search for Vinesauce . 4. Click Download on whatever stream you want to download. 5. Now, right click, and in the menu click downthemall. 6. The DTA window will open, then you will e able to select the FLV files all at once to download.

A piece of advice: I don't think you can change the file names before downloading, so make sure to make a folder that says what they are before you dump them in some big folder.

As far as telling them apart and the order: They should be in the order they appear on the page in the DTA window and the folder you download them to. So just be careful. If you are worried you can check the individual links that you get from the zazi.bar downloader.

Source: Vinesauce Forum User - RedBreloom

Jdownloader

Another way to make concurrent downloads.

Link: http://jdownloader.org/

Future Method: Mass Download with a Script

Usually I would use youtube-dl, but it has issues with Twitch due to the sudden change in policy.

I'll slap together a quick and dirty Python slurping script sooner or later.

External Links