Difference between revisions of "Jira"

From Archiveteam
Jump to navigation Jump to search
(archived projects)
(update archived issues script)
Line 17: Line 17:
{{URL|https://transfer.archivete.am/6rcal/jira_url_list_delux.py}} was used to generate lists of tickets from the API, as well as the API calls themselves, for two sites, though in both cases the script needed to be modified and using 1000 entries/request does not work well (100 entries/request seems much more stable). This was needed due to large numbers of nonexistent tickets due to either importing from another issue tracker or large amounts of deleted spam.
{{URL|https://transfer.archivete.am/6rcal/jira_url_list_delux.py}} was used to generate lists of tickets from the API, as well as the API calls themselves, for two sites, though in both cases the script needed to be modified and using 1000 entries/request does not work well (100 entries/request seems much more stable). This was needed due to large numbers of nonexistent tickets due to either importing from another issue tracker or large amounts of deleted spam.


3 sites (checked via {{URL|https://transfer.archivete.am/144iMs/jira_archived_check.py|jira_archived_check.py}}) have archived projects, which do not appear in search results. Issues for those projects were enumerated using {{URL|https://transfer.archivete.am/s2toW/jira_url_list_archived.py|jira_url_list_archived.py}} which incrementally issues HEAD requests.
3 sites (checked via {{URL|https://transfer.archivete.am/144iMs/jira_archived_check.py|jira_archived_check.py}}) have archived projects, which do not appear in search results. Issues for those projects were enumerated using {{URL|https://transfer.archivete.am/LNxR3/jira_url_list_archived.py|jira_url_list_archived.py}} which incrementally issues HEAD requests.


== Status ==
== Status ==
Line 109: Line 109:
| {{notsavedyet}} || || || || || || || offsite links
| {{notsavedyet}} || || || || || || || offsite links
|-
|-
|rowspan="5"| https://jira.atlassian.com/secure/Dashboard.jspa
|rowspan="6"| https://jira.atlassian.com/secure/Dashboard.jspa
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/Tu6NI/jira.atlassian.com.txt | jira.atlassian.com.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/86p16 86p16] || 2024-02-07 || || 7 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-jira.atlassian.com.txt-inf-20240207-184534-86p16-wpull.db.zst DB] || includes XML/HTML/DOC
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/Tu6NI/jira.atlassian.com.txt | jira.atlassian.com.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/86p16 86p16] || 2024-02-07 || || 7 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-jira.atlassian.com.txt-inf-20240207-184534-86p16-wpull.db.zst DB] || includes XML/HTML/DOC
|-
|-
Line 116: Line 116:
| {{notsavedyet}} || || || || || || || offsite links
| {{notsavedyet}} || || || || || || || offsite links
|-
|-
| {{inprogress}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/KhyzR/jira.atlassian.com_archived.txt|jira.atlassian.com_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/bq048 bq048] || 2024-02-27 || || || includes XML/HTML/DOC and offsite links
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/KhyzR/jira.atlassian.com_archived.txt|jira.atlassian.com_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/bq048 bq048] || 2024-02-27 || || 1 warc || includes XML/HTML/DOC and offsite links; incomplete due to gaps in issues leading script to give up early
|-
| {{inprogress}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/4YA9I/jira.atlassian.com_archived_redo.txt|jira.atlassian.com_archived_redo.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/e8mcd e8mcd] || 2024-02-28 || || || includes XML/HTML/DOC and offsite links
|-
|-
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments for archived projects
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments for archived projects
|-
|-
|rowspan="5"| https://issues.redhat.com/
|rowspan="6"| https://issues.redhat.com/
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/SglCS/issues.redhat.com.txt | issues.redhat.com.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/358sy 358sy] || 2024-02-07 || || 7 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-issues.redhat.com.txt-inf-20240207-184325-358sy-wpull.db.zst DB] || includes XML/HTML/DOC
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/SglCS/issues.redhat.com.txt | issues.redhat.com.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/358sy 358sy] || 2024-02-07 || || 7 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-issues.redhat.com.txt-inf-20240207-184325-358sy-wpull.db.zst DB] || includes XML/HTML/DOC
|-
|-
Line 127: Line 129:
| {{notsavedyet}} || || || || || || || offsite links
| {{notsavedyet}} || || || || || || || offsite links
|-
|-
| {{inprogress}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/8wv6Z/issues.redhat.com_archived.txt|issues.redhat.com_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/cfsye cfsye] || 2024-02-27 || || || includes XML/HTML/DOC and offsite links
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/8wv6Z/issues.redhat.com_archived.txt|issues.redhat.com_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/cfsye cfsye] || 2024-02-27 || || 1 warc || includes XML/HTML/DOC and offsite links; incomplete due to gaps in issues leading script to give up early
|-
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/PgImU/issues.redhat.com_archived_redo.txt|issues.redhat.com_archived_redo.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/3iwza 3iwza] || 2024-02-27 || || || includes XML/HTML/DOC and offsite links
|-
|-
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments for archived projects
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments for archived projects
Line 213: Line 217:
| {{saved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/4in9H/community.i2b2.org_jira.isi.edu._jira.o-ran-sc.org_jira.observium.org_attachments.txt|community.i2b2.org<wbr/>_jira.isi.edu.<wbr/>_jira.o-ran-sc.org<wbr/>_jira.observium.org_attachments.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/202402140626056apws 6apws] || 2024-02-14 || || 1 warc || 4 sites in 1; attachments
| {{saved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/4in9H/community.i2b2.org_jira.isi.edu._jira.o-ran-sc.org_jira.observium.org_attachments.txt|community.i2b2.org<wbr/>_jira.isi.edu.<wbr/>_jira.o-ran-sc.org<wbr/>_jira.observium.org_attachments.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/202402140626056apws 6apws] || 2024-02-14 || || 1 warc || 4 sites in 1; attachments
|-
|-
| {{inprogress}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/10nxwZ/jira.isi.edu_archived.txt|jira.isi.edu_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/248qg 248qg] || 2024-02-27 || || || archived project; XML/HTML/DOC; offsite links
| {{inprogress}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/10nxwZ/jira.isi.edu_archived.txt|jira.isi.edu_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/248qg 248qg] || 2024-02-27 || || 1 warc || archived project; XML/HTML/DOC; offsite links
|-
|-
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments from archived project
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments from archived project

Revision as of 05:46, 28 February 2024

Jira is a bug tracking system developed by Atlassian. They previously offered a self-hosted version (Jira Server), but have ended sales on Feb 15, 2023[1] and support will fully end on Feb 15, 2024,[2] leaving the only options as their cloud version[3] or the comically expensive data center version.[4]

Strategy

An ArchiveBot !a command will not properly discover all issues.

The approach I've used is to find the highest-numbered ticket in each project (use the "all issues" filter and order by "key"), and then generated a text file listing all of the ticket URLs, which then can be ran (by an op) as an !a < list job. However, this will not save issue attachments due to the no-parent rule, so in addition the job's database needs to be manually saved and the relevant links need to be extracted from the database, and can be run as a separate job.

Attachment mime types do get detected as a relative URL, and will need to be ignored, along the lines of https?://{primary_netloc}/browse/(application|text|image|video)/. Not all attachments are found like this due to a wpull quirk, so this is insufficient for getting a list of attachments.[5] Additionally, attachment sorting is not useful to save, so [?&]attachment(Order|ViewMode|SortBy)= can be ignored.

Issue comments are loaded via JS and are not properly saved. However, all comments are included when exporting an issue in "printable" form, as well as in the XML and DOC export formats. As such, these export links are worth saving (though they either need to be generated as a list or extracted from the job's database). https://example.com/si/jira.issueviews:issue-html/PROJ-12345/PROJ-12345.html

https://transfer.archivete.am/qMgJa/jira_url_list.py[IAWcite.todayMemWeb] generates a list of URLs, also using the Jira API[IAWcite.todayMemWeb] to determine the maximum issue for each project. https://transfer.archivete.am/6owk9/jira_process_db.py[IAWcite.todayMemWeb] extracts attachment URLs from databases. (Offsite links aren't done yet.)

A few sites have attachments that redirected to a login page, e.g. https://hub.spigotmc.org/jira/secure/attachment/10005/daf45dfd-da9b-498b-96e4-5782bbac11c7.dat from https://hub.spigotmc.org/jira/browse/SPIGOT-31. These are simply broken, and logging in results in a 404 page for those attachments. The attachment zip for those issues also gives a 500.

https://transfer.archivete.am/6rcal/jira_url_list_delux.py[IAWcite.todayMemWeb] was used to generate lists of tickets from the API, as well as the API calls themselves, for two sites, though in both cases the script needed to be modified and using 1000 entries/request does not work well (100 entries/request seems much more stable). This was needed due to large numbers of nonexistent tickets due to either importing from another issue tracker or large amounts of deleted spam.

3 sites (checked via jira_archived_check.py[IAWcite.todayMemWeb]) have archived projects, which do not appear in search results. Issues for those projects were enumerated using jira_url_list_archived.py[IAWcite.todayMemWeb] which incrementally issues HEAD requests.

Status

No public issues

References