Closed
Milestone

183: O.1.3. Review and update how we store and serve historical data

We are currently parsing network data and storing it in tarballs on collector.torproject.org. In parallel, we parse and ingest recent data into metricsdb for analysis and API access.

To ensure our data infrastructure remains reliable, maintainable, and accessible over time, we should make a concrete plan around the following areas:

  1. Historical Data Storage and Archiving
  2. Recurrent Ingestion and Archiving
  3. Archiving Time Series Data
  • Work items 5
  • Merge requests 1
  • Participants 1
  • Labels 7
Loading
Loading
Loading
Loading
20% complete
20%
Start date
No start date
None
Due date
No due date
5
Work items 5
Open: 4 Closed: 1
6
Total weight
6
1
Merge requests 1
Open: 0 Closed: 1 Merged: 0
0
Releases
None
Reference: tpo/network-health%"183: O.1.3. Review and update how we store and serve historical data"