Difference between revisions of "ArchiveBot/2019 European Union parliamentary elections/United Kingdom"
Jump to navigation
Jump to search
(Created very rough indication of current progress for UK EU elections) |
(Move URLs to /list subpage) Tag: Replaced |
||
| Line 1: | Line 1: | ||
__FORCETOC__ | __FORCETOC__ | ||
The main focus right now is on the candidates themselves, primarily their personal websites and social media. The main source of data for this was the [https://candidates.democracyclub.org.uk/help/api Democracy Club API], which gives a spreadsheet of candidates, their twitter usernames, their facebook pages, and campaign websites. The dataset is not complete (information for some candidates is missing) but enough data is present to make this effort workable. | The main focus right now is on the candidates themselves, primarily their personal websites and social media. The main source of data for this was the [https://candidates.democracyclub.org.uk/help/api Democracy Club API], which gives a spreadsheet of candidates, their twitter usernames, their facebook pages, and campaign websites. The dataset is not complete (information for some candidates is missing) but enough data is present to make this effort workable. | ||
== Twitter Archives == | == Twitter Archives == | ||
The Democracy Club dataset identified the following twitter usernames as belonging to UK MEP candidates. Presently, these usernames are being scraped using snscrape to create an initial list of URLs to feed into archivebot. | The Democracy Club dataset identified the following twitter usernames as belonging to UK MEP candidates. Presently, these usernames are being scraped using snscrape to create an initial list of URLs to feed into archivebot. | ||
<!-- bot:Twitter --><!-- /bot --> | |||
== Facebook Archives == | == Facebook Archives == | ||
The Democracy Club dataset identified the following facebook pages as belonging to UK MEP candidates. Presently, these pages are being scraped using snscrape to create an initial list of URLs to feed into archivebot. | |||
<!-- bot:Facebook --><!-- /bot --> | |||
== Candidate websites == | |||
The Democracy Club dataset identified the following websites as belonging to UK MEP candidates. Since archiving entire websites is more difficult than a social media page (which can be scraped for links prior to archiving) these are currently being fed into ArchiveBot in small chunks by JAA. Dependent on the progress of this, they will either all be archived in this manner, or only the homepages will be archived. | |||
<!-- bot:Candidate websites --><!-- /bot --> | |||
{{ArchiveBot}} | |||
[[Category:English]] | |||
Revision as of 21:24, 20 May 2019
The main focus right now is on the candidates themselves, primarily their personal websites and social media. The main source of data for this was the Democracy Club API, which gives a spreadsheet of candidates, their twitter usernames, their facebook pages, and campaign websites. The dataset is not complete (information for some candidates is missing) but enough data is present to make this effort workable.
Twitter Archives
The Democracy Club dataset identified the following twitter usernames as belonging to UK MEP candidates. Presently, these usernames are being scraped using snscrape to create an initial list of URLs to feed into archivebot.
Facebook Archives
The Democracy Club dataset identified the following facebook pages as belonging to UK MEP candidates. Presently, these pages are being scraped using snscrape to create an initial list of URLs to feed into archivebot.
Candidate websites
The Democracy Club dataset identified the following websites as belonging to UK MEP candidates. Since archiving entire websites is more difficult than a social media page (which can be scraped for links prior to archiving) these are currently being fed into ArchiveBot in small chunks by JAA. Dependent on the progress of this, they will either all be archived in this manner, or only the homepages will be archived.