Skip to content
Snippets Groups Projects
Verified Commit 0710d6d2 authored by anarcat's avatar anarcat
Browse files

detail largest disk consumers

parent 9cb3925e
No related branches found
No related tags found
No related merge requests found
......@@ -110,9 +110,9 @@ issue [tpo/tpa/team#40478][].
## Storage usage analysis
[According to Grafana][], TPA manages around 60TiB of storage with a
[According to Grafana][], TPA manages over 60TiB of storage with a
capacity of over 160TiB, which includes 60TiB of un-allocated space on
[LVM volume groups][].
[LVM volume groups][].
About 40TiB of storage is used by the backup storage server and 7TiB
by the archive servers, which puts our normal disk usage at less than
......@@ -121,12 +121,21 @@ by the archive servers, which puts our normal disk usage at less than
[According to Grafana]: https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?orgId=1
[LVM volume groups]: https://grafana.torproject.org/d/f7887271-1a77-4138-ad16-28be8b0ad0ab/lvm-disk-usage?orgId=1
Other large consumers include:
* GitLab: TODO
* mirrors:
* metrics
* etc
Top 10 largest disk consumers are:
1. Backups: [41TiB](https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?orgId=1&var-class=All&var-instance=bungei.torproject.org&var-instance=bacula-director-01.torproject.org)
2. archive-01: 6TiB
3. Tor Browser builders: [4TiB](https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?orgId=1&var-class=All&var-instance=tb-build-01.torproject.org&var-instance=tb-build-04.torproject.org&var-instance=tb-build-05.torproject.org&var-instance=tb-build-06.torproject.org&var-instance=tb-pkgstage-01.torproject.org&var-instance=tb-tester-01.torproject.org&var-instance=tbb-nightlies-master.torproject.org)
4. metrics: [3.6TiB](https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?orgId=1&var-class=All&var-instance=colchicifolium.torproject.org&var-instance=collector-02.torproject.org&var-instance=materculae.torproject.org&var-instance=meronense.torproject.org&var-instance=metrics-psqlts-01.torproject.org&var-instance=metrics-store-01.torproject.org&var-instance=metricsdb-01.torproject.org&var-instance=onionoo-backend-01.torproject.org&var-instance=onionoo-backend-02.torproject.org&var-instance=onionoo-frontend-01.torproject.org&var-instance=onionoo-frontend-02.torproject.org)
5. mirrors: ~[948GiB](https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?orgId=1&var-class=All&var-instance=hetzner-hel1-03.torproject.org&var-instance=cdn-backend-sunet-02.torproject.org&var-instance=web-dal-07.torproject.org&var-instance=web-dal-08.torproject.org&var-instance=web-fsn-01.torproject.org&var-instance=web-fsn-02.torproject.org&var-instance=palmeri.torproject.org&var-instance=static-gitlab-shim.torproject.org&var-instance=static-master-fsn.torproject.org&var-instance=staticiforme.torproject.org) total, ~100-200GiB each mirror/source
6. people.torproject.org: 743GiB
7. GitLab: [700GiB](https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?orgId=1&var-class=All&var-instance=ci-runner-x86-01.torproject.org&var-instance=gitlab-02.torproject.org&var-instance=chi-node-14.torproject.org) (350GiB for main instance, 90GiB per runner)
8. Prometheus: [150GiB](https://grafana.torproject.org/d/zbCoGRjnz/disk-usage?orgId=1&var-class=All&var-instance=hetzner-nbg1-01.torproject.org&var-instance=hetzner-nbg1-02.torproject.org)
9. Gitolite & GitWeb: 175GiB
10. BTCPayserver: 125GiB
The remaining servers all individually use less than 100GiB and are
negligible compared to the above mastodons.
# Proposal
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment