Open
Milestone
183: O.1.3. Review and update how we store and serve historical data
We are currently parsing network data and storing it in tarballs on collector.torproject.org. In parallel, we parse and ingest recent data into metricsdb for analysis and API access.
To ensure our data infrastructure remains reliable, maintainable, and accessible over time, we should make a concrete plan around the following areas:
- Historical Data Storage and Archiving
- Recurrent Ingestion and Archiving
- Archiving Time Series Data
Loading
Loading
Loading
Loading