Difference between revisions of "DeviantArt"

From Archiveteam
Jump to navigation Jump to search
m (Add IRC)
(Project has started.)
 
(13 intermediate revisions by 11 users not shown)
Line 1: Line 1:
{{Infobox project
{{Infobox project
| title = DeviantART
| title = DeviantART
| logo = DeviantArtLogo.png
| url = http://deviantart.com/
| url = http://deviantart.com/
| image = DeviantArt - December 2020.png
| project_status = {{online}}
| project_status = {{online}}
| archiving_status = {{notsavedyet}}
| archiving_status = {{inprogress}} (Groups)
| archiving_type = DPoS
| irc = devianttart
| irc = devianttart
| source = [https://github.com/ArchiveTeam/deviantart-grab deviantart-grab]
| tracker = [https://tracker.archiveteam.org/deviantart/ deviantart]
}}
}}


Currently there's few good solutions for backing up deviantarts, as the rest fail to build or fail to interact with the site, or just fail. Currently the best is “deviantart-gallery-downloader” by xofred.
Currently there's few good solutions for backing up deviantarts, as the rest fail to build or fail to interact with the site, or just fail. Currently the best is “deviantart-gallery-downloader” by xofred.
== Vital signs ==
=== Eclipse scare ===
In early 2020, DeviantArt moved to a new layout/style called "Eclipse". There was worry that this was a sign of decay<ref>https://archive.fart.website/bin/irclogger_log/archiveteam?date=2020-04-23,Thu&sel=194#l194</ref> or that dislike of it<ref>https://www.deviantart.com/pfaccioxx/journal/DA-Eclipse-the-issue-and-what-to-do-about-it-839260745</ref> would result in an exodus.
=== NFT scare ===
In late 2021, during the NFT craze, there was fear that submissions from DeviantArt were being used to make NFTs, and that this would result in a user exodus.
=== AI scare ===
In late 2022, DeviantArt introduced tools to generate and upload AI art to their website.<ref>https://twitter.com/DeviantArt/status/1591113199218487300</ref> This has led to artists deleting their accounts in protest.
=== Reintroduction of advertisements ===
In early 2023, DeviantArt reintroduced banner ads to their website, 4 years after removing them completely in 2019. It's possible this decision was made due to the aforementioned user exoduses.<ref>https://www.deviantart.com/team/journal/An-Update-About-Ads-954638854</ref>
=== Groups Redesign ===
On {{datetime|2023-09-27}}, DeviantArt unveiled a new layout design for Groups.<ref>https://www.deviantart.com/team/journal/A-New-Look-for-New-Groups-983841628</ref> While initially opt-in, they later announced on {{datetime|2023-12-06}} that inactive groups will be automatically migrated on {{datetime|2024-03-25}}, with all remaining groups being migrated by {{datetime|2024-04-08}}. As part of the migration, all data pertaining to custom widgets, favorites, group affiliations, countdown timers, admin forums, and admin announcements will be lost.<ref>https://www.deviantart.com/team/journal/Convert-your-group-to-a-new-design-994388001</ref> A DPoS project was started to grab this data.
== Software ==
=== deviantart-gallery-downloader ===


This script will get full-sized images, whereas right-clicking hasn't in the past. It will also check to see if things have already been ripped, and rip any new changes to reduce traffic.
This script will get full-sized images, whereas right-clicking hasn't in the past. It will also check to see if things have already been ripped, and rip any new changes to reduce traffic.


 
==== Things needed ====
== Things needed ==


* git
* git
Line 19: Line 42:
* A disposable dA account with adult images turned on (to make sure all images are gotten)
* A disposable dA account with adult images turned on (to make sure all images are gotten)


== Getting the software and dependencies ==
==== Getting the software and dependencies ====


  sudo apt-get install git ruby-dev
  sudo apt-get install git ruby-dev
Line 32: Line 55:




== Usage ==
==== Usage ====


To rip an an entire main gallery with no organization of the images on a album basis, run:
To rip an entire main gallery with no organization of the images on an album basis, run:


  ruby with_login.rb LOGIN-EMAIL PASSWORD "http://USERID.deviantart.com/gallery/?catpath=/"
  ruby with_login.rb LOGIN-EMAIL PASSWORD "http://USERID.deviantart.com/gallery/?catpath=/"
Line 44: Line 67:
  ruby with_login.rb LOGIN-EMAIL PASSWORD http://USERID.deviantart.com/ALBUM_NAME
  ruby with_login.rb LOGIN-EMAIL PASSWORD http://USERID.deviantart.com/ALBUM_NAME


== Caveats ==
==== Caveats ====


No SSL auth, this could be done with a slight re-jiggering of code and a dependency on some ruby-SSL dep to offload that work.
No SSL auth, this could be done with a slight re-jiggering of code and a dependency on some ruby-SSL dep to offload that work.
Line 51: Line 74:


*Use a burner account until this script is made a bit more secure*
*Use a burner account until this script is made a bit more secure*
=== downloadiant ===
[[User:TheTechRobo]] made a simple script to download a user's gallery URLs.
There's currently functions for scraping an individual post and a specific gallery, but that code is not yet exposed because it sucks.
It can also be used as a module. Documentation coming soon™
==== Things needed ====
* Python 3
* requests
* Preferably, a DeviantArt account (only watermarked images are available to anonymous users)
<i>this should preferably be a burner account</i>
* A cookies.txt file for that account (if you don't want to log in, make it an empty file)
==== Usage ====
Usage instructions can be found at [https://github.com/TheTechRobo/downloadiant the repo].
== Gallery ==
<gallery>
File:Deviantart-fullpage.jpg‎|DeviantART's home page in 2017
File:Deviantart submission IDs vs published dates.png|Submission IDs over time. The horizontal branch at around 240 million seems to be the result of mass assignment of IDs to preexisting journals.
</gallery>




{{Navigation box}}
{{Navigation box}}
[[Category:Image hosting]]
[[Category:Image hosting]]

Latest revision as of 18:47, 22 March 2024

DeviantART
DeviantArt logo
DeviantArt - December 2020.png
URL http://deviantart.com/
Status Online!
Archiving status In progress... (Groups)
Archiving type DPoS
Project source deviantart-grab
Project tracker deviantart
IRC channel #devianttart (on hackint)

Currently there's few good solutions for backing up deviantarts, as the rest fail to build or fail to interact with the site, or just fail. Currently the best is “deviantart-gallery-downloader” by xofred.

Vital signs

Eclipse scare

In early 2020, DeviantArt moved to a new layout/style called "Eclipse". There was worry that this was a sign of decay[1] or that dislike of it[2] would result in an exodus.

NFT scare

In late 2021, during the NFT craze, there was fear that submissions from DeviantArt were being used to make NFTs, and that this would result in a user exodus.

AI scare

In late 2022, DeviantArt introduced tools to generate and upload AI art to their website.[3] This has led to artists deleting their accounts in protest.

Reintroduction of advertisements

In early 2023, DeviantArt reintroduced banner ads to their website, 4 years after removing them completely in 2019. It's possible this decision was made due to the aforementioned user exoduses.[4]

Groups Redesign

On 2023-09-27, DeviantArt unveiled a new layout design for Groups.[5] While initially opt-in, they later announced on 2023-12-06 that inactive groups will be automatically migrated on 2024-03-25, with all remaining groups being migrated by 2024-04-08. As part of the migration, all data pertaining to custom widgets, favorites, group affiliations, countdown timers, admin forums, and admin announcements will be lost.[6] A DPoS project was started to grab this data.

Software

deviantart-gallery-downloader

This script will get full-sized images, whereas right-clicking hasn't in the past. It will also check to see if things have already been ripped, and rip any new changes to reduce traffic.

Things needed

  • git
  • gem (ruby-dev)
  • mechanize
  • A disposable dA account with adult images turned on (to make sure all images are gotten)

Getting the software and dependencies

sudo apt-get install git ruby-dev
sudo gem update
sudo gem install mechanize 
git clone https://github.com/xofred/deviantart-gallery-downloader.git
cd deviantart-gallery-downloader


Usage

To rip an entire main gallery with no organization of the images on an album basis, run:

ruby with_login.rb LOGIN-EMAIL PASSWORD "http://USERID.deviantart.com/gallery/?catpath=/"

That "/?catpath=/" on the end is important because it grabs all the images where as with the default gallery URL it does not.

For an album:

ruby with_login.rb LOGIN-EMAIL PASSWORD http://USERID.deviantart.com/ALBUM_NAME

Caveats

No SSL auth, this could be done with a slight re-jiggering of code and a dependency on some ruby-SSL dep to offload that work.

User creds are in the process name being run. Use with caution on a multi-user system. A simple ps -A will reveal your creds.

  • Use a burner account until this script is made a bit more secure*

downloadiant

User:TheTechRobo made a simple script to download a user's gallery URLs.

There's currently functions for scraping an individual post and a specific gallery, but that code is not yet exposed because it sucks.

It can also be used as a module. Documentation coming soon™

Things needed

  • Python 3
  • requests
  • Preferably, a DeviantArt account (only watermarked images are available to anonymous users)

this should preferably be a burner account

  • A cookies.txt file for that account (if you don't want to log in, make it an empty file)

Usage

Usage instructions can be found at the repo.

Gallery