Skip to content

Improve recurrent tasks and use of resources in collector and on colchicifolium.

We have been having various issues with backups, use of resources and recurrent tasks on colchicifolium.

I have started to look at the create-tarballs.sh script to see if this can be optimized and run in less time (possibly even stressing the machine less). I have created !7 (merged)

I am also thinking that on https://gitlab.torproject.org/tpo/network-health/metrics/collector/-/blob/master/src/main/resources/create-tarballs.sh#L117 we touch a lot of directories and sub directories and I wonder if this ends up messing up with our backups because we touch a lot of files.

CC peeps on the sysadmin team @lavamind @anarcat