Difference between revisions of "Jira"

From Archiveteam
Jump to navigation Jump to search
(archived projects)
Line 16: Line 16:


{{URL|https://transfer.archivete.am/6rcal/jira_url_list_delux.py}} was used to generate lists of tickets from the API, as well as the API calls themselves, for two sites, though in both cases the script needed to be modified and using 1000 entries/request does not work well (100 entries/request seems much more stable). This was needed due to large numbers of nonexistent tickets due to either importing from another issue tracker or large amounts of deleted spam.
{{URL|https://transfer.archivete.am/6rcal/jira_url_list_delux.py}} was used to generate lists of tickets from the API, as well as the API calls themselves, for two sites, though in both cases the script needed to be modified and using 1000 entries/request does not work well (100 entries/request seems much more stable). This was needed due to large numbers of nonexistent tickets due to either importing from another issue tracker or large amounts of deleted spam.
3 sites (checked via {{URL|https://transfer.archivete.am/144iMs/jira_archived_check.py|jira_archived_check.py}}) have archived projects, which do not appear in search results. Issues for those projects were enumerated using {{URL|https://transfer.archivete.am/s2toW/jira_url_list_archived.py|jira_url_list_archived.py}} which incrementally issues HEAD requests.


== Status ==
== Status ==
Line 107: Line 109:
| {{notsavedyet}} || || || || || || || offsite links
| {{notsavedyet}} || || || || || || || offsite links
|-
|-
|rowspan="3"| https://jira.atlassian.com/secure/Dashboard.jspa
|rowspan="5"| https://jira.atlassian.com/secure/Dashboard.jspa
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/Tu6NI/jira.atlassian.com.txt | jira.atlassian.com.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/86p16 86p16] || 2024-02-07 || || 7 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-jira.atlassian.com.txt-inf-20240207-184534-86p16-wpull.db.zst DB] || includes XML/HTML/DOC
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/Tu6NI/jira.atlassian.com.txt | jira.atlassian.com.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/86p16 86p16] || 2024-02-07 || || 7 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-jira.atlassian.com.txt-inf-20240207-184534-86p16-wpull.db.zst DB] || includes XML/HTML/DOC
|-
|-
Line 114: Line 116:
| {{notsavedyet}} || || || || || || || offsite links
| {{notsavedyet}} || || || || || || || offsite links
|-
|-
|rowspan="3"| https://issues.redhat.com/
| {{inprogress}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/KhyzR/jira.atlassian.com_archived.txt|jira.atlassian.com_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/bq048 bq048] || 2024-02-27 || || || includes XML/HTML/DOC and offsite links
|-
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments for archived projects
|-
|rowspan="5"| https://issues.redhat.com/
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/SglCS/issues.redhat.com.txt | issues.redhat.com.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/358sy 358sy] || 2024-02-07 || || 7 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-issues.redhat.com.txt-inf-20240207-184325-358sy-wpull.db.zst DB] || includes XML/HTML/DOC
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/SglCS/issues.redhat.com.txt | issues.redhat.com.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/358sy 358sy] || 2024-02-07 || || 7 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-issues.redhat.com.txt-inf-20240207-184325-358sy-wpull.db.zst DB] || includes XML/HTML/DOC
|-
|-
Line 120: Line 126:
|-
|-
| {{notsavedyet}} || || || || || || || offsite links
| {{notsavedyet}} || || || || || || || offsite links
|-
| {{inprogress}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/8wv6Z/issues.redhat.com_archived.txt|issues.redhat.com_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/cfsye cfsye] || 2024-02-27 || || || includes XML/HTML/DOC and offsite links
|-
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments for archived projects
|-
|-
|rowspan="2"| https://jira.mariadb.org/
|rowspan="2"| https://jira.mariadb.org/
Line 141: Line 151:
| {{notsavedyet}} || || || || || || || offsite links
| {{notsavedyet}} || || || || || || || offsite links
|-
|-
|rowspan="7"| https://bugs.openjdk.org/
|rowspan="9"| https://bugs.openjdk.org/
| {{partiallysaved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/gKIuN/bugs.openjdk.org_search_urls.txt|bugs.openjdk.org_search_urls.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/20240212232728cgwcr cgwcr] || 2024-02-12 || || 1 warc || search API urls from [https://transfer.archivete.am/vqJxk/jira_url_list_delux_openjdk.py script], some failed due to size
| {{partiallysaved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/gKIuN/bugs.openjdk.org_search_urls.txt|bugs.openjdk.org_search_urls.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/20240212232728cgwcr cgwcr] || 2024-02-12 || || 1 warc || search API urls from [https://transfer.archivete.am/vqJxk/jira_url_list_delux_openjdk.py script], some failed due to size
|-
|-
Line 150: Line 160:
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/SwT1Z/bugs.openjdk.org_issue_urls_continue_browse_urls.txt|bugs.openjdk.org_issue_urls_continue_browse_urls.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/1olv7 1olv7] || 2024-02-15 || || 2 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240220210552_39352483/urls-transfer.archivete.am-bugs.openjdk.org_issue_urls_continue_browse_urls.txt-inf-20240215-054356-1olv7-wpull.db.zst DB] || ticket URLs not completed by the job above, no offsite links or XML/HTML/DOC
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/SwT1Z/bugs.openjdk.org_issue_urls_continue_browse_urls.txt|bugs.openjdk.org_issue_urls_continue_browse_urls.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/1olv7 1olv7] || 2024-02-15 || || 2 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240220210552_39352483/urls-transfer.archivete.am-bugs.openjdk.org_issue_urls_continue_browse_urls.txt-inf-20240215-054356-1olv7-wpull.db.zst DB] || ticket URLs not completed by the job above, no offsite links or XML/HTML/DOC
|-
|-
| {{inprogress}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/LYgQu/bugs.openjdk.org_attachment_urls.txt|bugs.openjdk.org_attachment_urls.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/aelg7 aelg7] || 2024-02-21 || || || attachments
| {{partiallysaved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/LYgQu/bugs.openjdk.org_attachment_urls.txt|bugs.openjdk.org_attachment_urls.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/aelg7 aelg7] || 2024-02-21 || || || attachments, banned partway through
|-
| {{saved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/6nuFQ/bugs.openjdk.org_attachment_urls_resume_1.txt|bugs.openjdk.org_attachment_urls_resume_1.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/202402221650519m599 9m599] || 2024-02-22 || || || attachments not saved by above
|-
|-
| {{notsavedyet}} || || || || || || || XML/HTML/DOC
| {{inprogress}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/zSOz6/bugs.openjdk.org_issue_urls_html.txt|bugs.openjdk.org_issue_urls_html.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/4gnwn 4gnwn] || 2024-02-25 || || || HTML (to get offsite links later)
|-
| {{notsavedyet}} || || || || || || || XML/DOC
|-
|-
| {{notsavedyet}} || || || || || || || offsite links
| {{notsavedyet}} || || || || || || || offsite links
Line 194: Line 208:
| {{saved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/ylPKd/issues.rivetlogic.org_jira.akraino.org_jira.astppbilling.org_pfspipe.ipmu.jp_attachments.txt|issues.rivetlogic.org<wbr/>_jira.akraino.org<wbr/>_jira.astppbilling.org<wbr/>_pfspipe.ipmu.jp_attachments.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/202402140859263plai 3plai] || 2024-02-14 || || 1 warc || 4 sites in 1; attachments
| {{saved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/ylPKd/issues.rivetlogic.org_jira.akraino.org_jira.astppbilling.org_pfspipe.ipmu.jp_attachments.txt|issues.rivetlogic.org<wbr/>_jira.akraino.org<wbr/>_jira.astppbilling.org<wbr/>_pfspipe.ipmu.jp_attachments.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/202402140859263plai 3plai] || 2024-02-14 || || 1 warc || 4 sites in 1; attachments
|-
|-
|rowspan="2"| https://community.i2b2.org/jira/<br/>https://jira.isi.edu/<br/>https://jira.o-ran-sc.org/<br/>https://jira.observium.org/
|rowspan="4"| https://community.i2b2.org/jira/<br/>https://jira.isi.edu/<br/>https://jira.o-ran-sc.org/<br/>https://jira.observium.org/
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/19xUN/community.i2b2.org_jira.isi.edu._jira.o-ran-sc.org_jira.observium.org.txt|community.i2b2.org<wbr/>_jira.isi.edu.<wbr/>_jira.o-ran-sc.org<wbr/>_jira.observium.org.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/202402100545158n67a 8n67a] || 2024-02-10 || || 2 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-community.i2b2.org_jira.isi.edu._jira.o-ran-sc.org_jira.observium.org.txt-inf-20240210-054515-8n67a-wpull.db.zst DB] || 4 sites in 1; XML/HTML/DOC; offsite links
| {{saved}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/19xUN/community.i2b2.org_jira.isi.edu._jira.o-ran-sc.org_jira.observium.org.txt|community.i2b2.org<wbr/>_jira.isi.edu.<wbr/>_jira.o-ran-sc.org<wbr/>_jira.observium.org.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/202402100545158n67a 8n67a] || 2024-02-10 || || 2 warcs, [https://archive.org/download/archiveteam_archivebot_go_20240214051654_6cb84c30/urls-transfer.archivete.am-community.i2b2.org_jira.isi.edu._jira.o-ran-sc.org_jira.observium.org.txt-inf-20240210-054515-8n67a-wpull.db.zst DB] || 4 sites in 1; XML/HTML/DOC; offsite links
|-
|-
| {{saved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/4in9H/community.i2b2.org_jira.isi.edu._jira.o-ran-sc.org_jira.observium.org_attachments.txt|community.i2b2.org<wbr/>_jira.isi.edu.<wbr/>_jira.o-ran-sc.org<wbr/>_jira.observium.org_attachments.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/202402140626056apws 6apws] || 2024-02-14 || || 1 warc || 4 sites in 1; attachments
| {{saved}} || [[ArchiveBot]] (!ao < list) || {{URLAB|https://transfer.archivete.am/4in9H/community.i2b2.org_jira.isi.edu._jira.o-ran-sc.org_jira.observium.org_attachments.txt|community.i2b2.org<wbr/>_jira.isi.edu.<wbr/>_jira.o-ran-sc.org<wbr/>_jira.observium.org_attachments.txt}}<!-- not zst --> || [https://archive.fart.website/archivebot/viewer/job/202402140626056apws 6apws] || 2024-02-14 || || 1 warc || 4 sites in 1; attachments
|-
| {{inprogress}} || [[ArchiveBot]] (!a < list) || {{URLAB|https://transfer.archivete.am/10nxwZ/jira.isi.edu_archived.txt|jira.isi.edu_archived.txt}}<!-- zst --> || [https://archive.fart.website/archivebot/viewer/job/248qg 248qg] || 2024-02-27 || || || archived project; XML/HTML/DOC; offsite links
|-
| {{notsavedyet}} || [[ArchiveBot]] (!ao < list) || || || || || || attachments from archived project
|-
|-
|rowspan="2"| https://jira.sammeth.net/<br/>https://jira.translate5.net/<br/>https://sbforge.org/jira/<br/>https://www.quickfixj.org/jira/
|rowspan="2"| https://jira.sammeth.net/<br/>https://jira.translate5.net/<br/>https://sbforge.org/jira/<br/>https://www.quickfixj.org/jira/

Revision as of 06:57, 27 February 2024

Jira is a bug tracking system developed by Atlassian. They previously offered a self-hosted version (Jira Server), but have ended sales on Feb 15, 2023[1] and support will fully end on Feb 15, 2024,[2] leaving the only options as their cloud version[3] or the comically expensive data center version.[4]

Strategy

An ArchiveBot !a command will not properly discover all issues.

The approach I've used is to find the highest-numbered ticket in each project (use the "all issues" filter and order by "key"), and then generated a text file listing all of the ticket URLs, which then can be ran (by an op) as an !a < list job. However, this will not save issue attachments due to the no-parent rule, so in addition the job's database needs to be manually saved and the relevant links need to be extracted from the database, and can be run as a separate job.

Attachment mime types do get detected as a relative URL, and will need to be ignored, along the lines of https?://{primary_netloc}/browse/(application|text|image|video)/. Not all attachments are found like this due to a wpull quirk, so this is insufficient for getting a list of attachments.[5] Additionally, attachment sorting is not useful to save, so [?&]attachment(Order|ViewMode|SortBy)= can be ignored.

Issue comments are loaded via JS and are not properly saved. However, all comments are included when exporting an issue in "printable" form, as well as in the XML and DOC export formats. As such, these export links are worth saving (though they either need to be generated as a list or extracted from the job's database). https://example.com/si/jira.issueviews:issue-html/PROJ-12345/PROJ-12345.html

https://transfer.archivete.am/qMgJa/jira_url_list.py[IAWcite.todayMemWeb] generates a list of URLs, also using the Jira API[IAWcite.todayMemWeb] to determine the maximum issue for each project. https://transfer.archivete.am/6owk9/jira_process_db.py[IAWcite.todayMemWeb] extracts attachment URLs from databases. (Offsite links aren't done yet.)

A few sites have attachments that redirected to a login page, e.g. https://hub.spigotmc.org/jira/secure/attachment/10005/daf45dfd-da9b-498b-96e4-5782bbac11c7.dat from https://hub.spigotmc.org/jira/browse/SPIGOT-31. These are simply broken, and logging in results in a 404 page for those attachments. The attachment zip for those issues also gives a 500.

https://transfer.archivete.am/6rcal/jira_url_list_delux.py[IAWcite.todayMemWeb] was used to generate lists of tickets from the API, as well as the API calls themselves, for two sites, though in both cases the script needed to be modified and using 1000 entries/request does not work well (100 entries/request seems much more stable). This was needed due to large numbers of nonexistent tickets due to either importing from another issue tracker or large amounts of deleted spam.

3 sites (checked via jira_archived_check.py[IAWcite.todayMemWeb]) have archived projects, which do not appear in search results. Issues for those projects were enumerated using jira_url_list_archived.py[IAWcite.todayMemWeb] which incrementally issues HEAD requests.

Status

No public issues

References