retire jenkins by December 1st 2021

following #40167 (closed) (TPA-RFC-10), it was decided in April 2021 that Jenkins should be retired in 2021. specifically, the host (rouyi) will be retired on December 1st, if all goes well.

This ticket is set to track that progress. The due date is set 3 months before the actual retirement date (September) so that we get a heads up to check the status before the retirement.

In the meantime, teams are expected to start migrating their jobs to GitLab CI progressively. Reminders may be sent in the meantime if people need prodding.

Those are the configured jobs in jenkins/jobs.git:

• hugo-website.yaml #40364 (closed)
• lektor-website.yaml - see %Retire Jenkins for the per-site tickets, only tpo/web/dev#13 (closed) (dev.tpo) remains, but it's not really deployed by jenkins anyways, so not a blocker
• onionperf-docs.yaml - obsolete (https://gitlab.torproject.org/tpo/metrics/onionperf/-/issues/40028)
• stem.yaml - obsolete
• tor-extra-libs-windows.yaml - #40225 (closed)
• tor.yaml
  • most tor builds #40225 (closed)
  • doxygen builds tpo/core/tor#40384 (closed)
  • Debian packages #40241 (closed)
• torsocks.yaml - retired after approval from dgoulet
• website.yaml - to retire, see tpo/web/team#13 (closed)

The above list might be expanded to explicitly cover all individual jobs if people have trouble migrating.

Update: as of 2021-08-30, only Debian packages and websites are left to migrate out of Jenkins. The plan for those is to deploy static components from GitLab CI (#40364 (closed)) with a "web hook" to trigger the deployment on the static mirror system. The timeline is generally like this:

1. setup a webhook system
2. test deployment of status.torproject.org
3. launch blog.torproject.org migrate research.torproject.org (tpo/web/research#40005 (closed))
4. migrate the rest of the websites (we are here, see %Retire Jenkins for all the tickets

Details of the deployment mechanism in #40364 (closed).

The following task list was set in #40167 (closed), to be executed once all (or some?) the above jobs are migrated or retired:

• windows build boxes retirement:
  • winklerianum ("not configured")
  • weissii
  • woronowii
• NAT box retirement (nat-fsn-01.torproject.org, when all Windows buildbox are retired)
• Linux build boxes retirement (build-$ARCH-$NN.torproject.org, build box purpose in LDAP)
  • build-x86-05 (moly)
  • build-x86-06 (moly)
  • build-x86-11 (gnt-fsn)
  • build-x86-13 (gnt-chi)
  • ci-runner-arm64-02.torproject.org (NOT the entire machine, but a buildbox role was added to the CI runner, and should be cleaned up)
• Jenkins box retirement (rouyi.torproject.org)
• Puppet code cleanup (retire buildbox and Jenkins code)
• git code cleanup (archive Jenkins repositories)

This ticket used to track all the work for the jenkins retirement, but there is now a milestone (%Retire Jenkins) to collect all those tickets, because it has grown to cover a lot of things. Therefore this ticket is just the retirement of Jenkins itself (and its associated servers listed right above), not the migration of sites themselves, which is covered by the milestone.