Skip to content
Snippets Groups Projects
Commit a9cacfa9 authored by Gaba's avatar Gaba :gay_pride_flag:
Browse files

Update 2021

parent 58e884bf
No related branches found
No related tags found
No related merge requests found
......@@ -24,18 +24,18 @@ attention. In general, the over-arching goals are therefore:
## Must have
* [ ] email delivery improvements:
* [x] handle bounces in CiviCRM ([issue 33037](https://gitlab.torproject.org/tpo/tpa/team/-/issues/33037))
* [ ] systematically followup on and respond to abuse complaints (https://gitlab.torproject.org/tpo/tpa/team/-/issues/40168)
* [ ] diagnose and resolve delivery issues (e.g. [Yahoo](https://gitlab.torproject.org/tpo/tpa/team/-/issues/34134),
[state.gov](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40202), [Gmail](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40170), [Gmail again](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40149))
* [x] handle bounces in CiviCRM ([issue 33037](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/33037))
* [ ] systematically followup on and respond to abuse complaints (http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40168)
* [ ] diagnose and resolve delivery issues (e.g. [Yahoo](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/34134),
[state.gov](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40202), [Gmail](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40170), [Gmail again](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40149))
* [ ] provide reliable delivery for users ("my email ends up in
spam!"), possibly by following newer standards like SPF,
DKIM, DMARC... ([issue 40363](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40363))
DKIM, DMARC... ([issue 40363](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40363))
* [ ] possible implementations:
* [ ] setup a new MX server to receive incoming email, with
"real" (Let's encrypt) TLS certificates, routing to
"legacy" (eugeni) mail server
* [ ] setup submit-01 to deliver people's emails ([issue 30608](https://gitlab.torproject.org/tpo/tpa/team/-/issues/30608))
* [ ] setup submit-01 to deliver people's emails ([issue 30608](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/30608))
* [ ] split mailing lists out of eugeni (build a new mailman 3
mail server?)
* [ ] split schleuder out of eugeni (or retire?)
......@@ -43,25 +43,25 @@ attention. In general, the over-arching goals are therefore:
email, particularly RT and CiviCRM)
* [ ] retire eugeni (if there is really nothing else left on it)
* [ ] retire old services:
* [ ] SVN ([issue 17202](https://gitlab.torproject.org/tpo/tpa/team/-/issues/17202))
* [ ] fpcentral ([issue 40009](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40009))
* [ ] SVN ([issue 17202](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/17202))
* [ ] fpcentral ([issue 40009](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40009))
* [ ] scale GitLab with ongoing and surely expanding usage
* [ ] possibly split in multiple server
* [ ] throw more hardware at it?
* [ ] monitoring?
* [ ] provide reliable and simple continuous integration services
* [ ] retire Jenkins (https://gitlab.torproject.org/tpo/tpa/team/-/issues/40218)
* [ ] retire Jenkins (http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40218)
* [ ] replace with GitLab CI, with Windows, Mac and Linux runners
* [ ] [fix the blog formatting and comment moderation](https://gitlab.torproject.org/tpo/web/blog-trac/-/issues/33115), possible solutions:
* [ ] migrate to a static website and Discourse https://gitlab.torproject.org/tpo/tpa/team/-/issues/40183 https://gitlab.torproject.org/tpo/tpa/team/-/issues/40297
* [ ] [fix the blog formatting and comment moderation](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/web/blog-trac/-/issues/33115), possible solutions:
* [ ] migrate to a static website and Discourse http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40183 http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40297
* [ ] improve communications and monitoring:
* [x] document "downtimes of 1 hour or longer", in a status page [issue
40138](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40138)
40138](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40138)
* [ ] reduce alert fatigue in Nagios
* [ ] publicize debugging tools (Grafana, user-level logging in systemd
services)
* [ ] encourage communication and ticket creation
* [ ] move root@ and tpa "noise" to RT ([ticket 31242]( https://gitlab.torproject.org/tpo/tpa/team/-/issues/31242)), make a real
* [ ] move root@ and tpa "noise" to RT ([ticket 31242]( http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/31242)), make a real
mailing list for admins so that gaba and non-tech can join
* [ ] be realistic:
* [ ] cover for the day-to-day routine tasks
......@@ -73,28 +73,28 @@ attention. In general, the over-arching goals are therefore:
## Nice to have
* [ ] improve sysadmin code base
* [ ] implement an ENC for Puppet ([issue 40358](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40358))
* [ ] implement an ENC for Puppet ([issue 40358](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40358))
* [ ] avoid YOLO commits in Puppet (possibly: server-side linting, CI)
* [ ] publish our Puppet repository ([ticket 29387](https://gitlab.torproject.org/tpo/tpa/team/-/issues/29387))
* [ ] reduce dependency on Python 2 code (see [short term LDAP plan](https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/ldap#short-term-merge-with-upstream-port-to-python-3-if-necessary))
* [ ] publish our Puppet repository ([ticket 29387](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/29387))
* [ ] reduce dependency on Python 2 code (see [short term LDAP plan](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/wikis/howto/ldap#short-term-merge-with-upstream-port-to-python-3-if-necessary))
* [ ] reduce dependency on LDAP (move hosts to Puppet? see [mid term
LDAP plan](https://gitlab.torproject.org/tpo/tpa/team/-/wikis/howto/ldap#mid-term-move-hosts-to-puppet-possibly-replace-ud-ldap-with-simpler-dashboard))
LDAP plan](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/wikis/howto/ldap#mid-term-move-hosts-to-puppet-possibly-replace-ud-ldap-with-simpler-dashboard))
* [ ] avoid duplicate git hosting infrastructure
* [ ] retire gitolite, gitweb ([issue 36](https://gitlab.torproject.org/tpo/tpa/gitlab/-/issues/36))
* [ ] retire gitolite, gitweb ([issue 36](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/gitlab/-/issues/36))
* [ ] retire more old services:
* [ ] testnet? talk to network team
* [ ] gitolite (replaced with GitLab, see above)
* [ ] gitweb (replaced with GitLab, see above)
* [ ] provide secure, end-to-end authentication of Tor source code
([issue 81](https://gitlab.torproject.org/tpo/tpa/gitlab/-/issues/81))
* [ ] finish retiring old hardware (moly, [ticket 29974](https://gitlab.torproject.org/legacy/trac/-/issues/29974))
([issue 81](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/gitlab/-/issues/81))
* [ ] finish retiring old hardware (moly, [ticket 29974](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/legacy/trac/-/issues/29974))
* [ ] varnish to nginx conversion (#32462)
* [x] GitLab pages hosting (see [issue tpo/tpa/gitlab#91](https://gitlab.torproject.org/tpo/tpa/gitlab/-/issues/91))
* [x] GitLab pages hosting (see [issue tpo/tpa/gitlab#91](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/gitlab/-/issues/91))
* [ ] experiment with containers/kubernetes for CI/CD
* [ ] upgrade to bullseye
* [ ] cover for some metrics services ([issue 40125](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40125))
* [ ] cover for some metrics services ([issue 40125](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40125))
* [ ] help other teams integrate their monitoring with
Prometheus/Grafana (e.g. [Matrix alerts](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40216),
Prometheus/Grafana (e.g. [Matrix alerts](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40216),
tpo/tpa/team#40089, tpo/tpa/team#40080, tpo/tpa/team#31159)
## Non-goals
......@@ -132,24 +132,24 @@ certain to be able to complete within the next few months or
so. Postponing those could cause problems.
* [x] email delivery improvements:
* [x] handle bounces in CiviCRM ([issue 33037](https://gitlab.torproject.org/tpo/tpa/team/-/issues/33037))
* [x] handle bounces in CiviCRM ([issue 33037](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/33037))
* [x] followup on abuse complaints
(https://gitlab.torproject.org/tpo/tpa/team/-/issues/40168) -
(http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40168) -
we do a systematic check of incoming bounces and actively
remove people from the CiviCRM newsletter or mailing lists
when we receive complaints
* [x] diagnose <del>and resolve</del> delivery issue (e.g. [yahoo delivery
problems](https://gitlab.torproject.org/tpo/tpa/team/-/issues/34134),
https://gitlab.torproject.org/tpo/tpa/team/-/issues/40168)
problems](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/34134),
http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40168)
problems seem to be due to the lack of SPF and DMARC records,
which we can't add until we setup submit-01. also, we need real
certs for accepting mails over TLS for some servers, so we should
setup an MX that supports that
* [x] GitLab CI deployment ([issue 40145](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40145))
* [x] Jenkins retirement plan (https://gitlab.torproject.org/tpo/tpa/team/-/issues/40167)
* [x] GitLab CI deployment ([issue 40145](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40145))
* [x] Jenkins retirement plan (http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40167)
* [x] setup a long-term/sponsored discourse instance?
* [x] document "downtimes of 1 hour or longer", in a status page [issue
40138](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40138)
40138](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40138)
## Q2
......@@ -159,12 +159,12 @@ wait a little longer or that are part of longer projects that will
take longer to complete.
* [x] <del>retire old services:</del> postponed
* [x] <del>SVN ([issue 17202](https://gitlab.torproject.org/tpo/tpa/team/-/issues/17202))</del> postponed to Q4/2022
* [x] fpcentral retirement plan ([issue 40009](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40009))
* [x] <del>establish plan for gitolite/gitweb retirement ([issue 36](https://gitlab.torproject.org/tpo/tpa/gitlab/-/issues/36))</del> postponed to Q4
* [x] <del>SVN ([issue 17202](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/17202))</del> postponed to Q4/2022
* [x] fpcentral retirement plan ([issue 40009](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40009))
* [x] <del>establish plan for gitolite/gitweb retirement ([issue 36](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/gitlab/-/issues/36))</del> postponed to Q4
* [x] <del>improve sysadmin code base</del> postponed to 2022 or drive-by fixes
* [x] <del>scale/split gitlab?</del> seems to be working fine and we setup new builders already
* [x] onion v3 support for TPA services (https://gitlab.torproject.org/tpo/tpa/team/-/issues/32824)
* [x] onion v3 support for TPA services (http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/32824)
Update: many of those tasks were not done because of lack of staff due
to an unplanned leave.
......@@ -181,7 +181,7 @@ everything in the air, so obviously plans kind of went out the
window. Hopefully this won't happen again and the pandemic will
somewhat subside, but we should plan for the worst.
* [ ] establish solid blog migration plan, see [blog service](service/blog) and https://gitlab.torproject.org/tpo/tpa/team/-/issues/40183 tpo/tpa/team#40297
* [ ] establish solid blog migration plan, see [blog service](service/blog) and http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40183 tpo/tpa/team#40297
* [ ] improve communications/monitoring
* [ ] move root@ and tpa "noise" to RT (tpo/tpa/team#31242), make a real mailing list for admins so that gaba and non-tech can join
* [ ] vacations
......@@ -196,14 +196,14 @@ will be on training and onboarding, and a well-deserved vacation.
Obviously, the fourth quarter is sheer crystal balling at this stage,
but it should still be an interesting exercise to perform.
* [ ] blog retirement before Drupal 9 EOL (November 2021)
* [ ] gitolite/gitweb retirement plan ([issue 36](https://gitlab.torproject.org/tpo/tpa/gitlab/-/issues/36))
* [ ] jenkins retirement https://gitlab.torproject.org/tpo/tpa/team/-/issues/40218
* [ ] SVN retirement plan ([issue 17202](https://gitlab.torproject.org/tpo/tpa/team/-/issues/17202))
* [ ] fpcentral retirement ([issue 40009](https://gitlab.torproject.org/tpo/tpa/team/-/issues/40009))
* [ ] [blog retirement](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/groups/tpo/-/milestones/26) before Drupal 9 EOL (November 2021)
* [ ] gitolite/gitweb retirement plan ([issue 36](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/gitlab/-/issues/36))
* [ ] [jenkins retirement](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/groups/tpo/-/milestones/27)
* [ ] SVN retirement plan ([issue 17202](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/17202))
* [ ] fpcentral retirement ([issue 40009](http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40009))
* [ ] setup submit-01 to deliver people's emails (tpo/tpa/team#30608)
* [ ] redo the user survey and 2022 roadmap (https://gitlab.torproject.org/tpo/tpa/team/-/issues/40307)
* [ ] BTCpayserver hosting (https://gitlab.torproject.org/tpo/tpa/team/-/issues/33750)
* [ ] redo the user survey and 2022 roadmap (http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40307)
* [ ] BTCpayserver hosting (http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/33750)
# 2020 roadmap evaluation
......@@ -663,7 +663,7 @@ above.
* someone was unhappy about backups, but did not seem to state why
* research: very little use, comment: "whenever I need to upload something to research.tpo, it seems like I need to investigate how to do so all over again. This is probably my fault for not remembering? "
* media: people are unhappy about it: "it would be nice to have something better than what we have now, which is an old archive" and "unmaintained", but it's unclear how to move forward on this from TPA's perspective
* fpcentral: one yearly user, one unhappy person suggested to retire it, which is already planned (https://gitlab.torproject.org/tpo/tpa/team/-/issues/40009)
* fpcentral: one yearly user, one unhappy person suggested to retire it, which is already planned (http://eweiibe6tdjsdprb4px6rqrzzcsi22m4koia44kc5pcjr7nec2rlxyad.onion/tpo/tpa/team/-/issues/40009)
Every other service not mentioned here should consider itself "happy". In particular, people are generally happy with websites, TPA and metrics services overall, so congratulations to every sysadmin and service admin out there and thanks for your feedback for those who filled in the survey!
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment