Skip to content
GitLab
  • Menu
Projects Groups Snippets
  • Help
    • Help
    • Support
    • Community forum
    • Submit feedback
    • Contribute to GitLab
  • Sign in
  • C Collector
  • Project information
    • Project information
    • Activity
    • Labels
    • Members
  • Repository
    • Repository
    • Files
    • Commits
    • Branches
    • Tags
    • Contributors
    • Graph
    • Compare
  • Issues 21
    • Issues 21
    • List
    • Boards
    • Service Desk
    • Milestones
  • Merge requests 0
    • Merge requests 0
  • CI/CD
    • CI/CD
    • Pipelines
    • Jobs
    • Schedules
  • Deployments
    • Deployments
    • Environments
    • Releases
  • Monitor
    • Monitor
    • Incidents
  • Analytics
    • Analytics
    • Value stream
    • CI/CD
    • Repository
  • Activity
  • Graph
  • Create a new issue
  • Jobs
  • Commits
  • Issue Boards
Collapse sidebar
  • The Tor Project
  • Network Health
  • Metrics
  • Collector
  • Issues
  • #20236
Closed
Open
Created Sep 24, 2016 by Karsten Loesing@karsten

Make changes to bridgedescs module for bulk-processing tarballs

I recently finished re-processing the entire bridge descriptor archive for legacy/trac#19317 (moved). However, I had to make some changes to avoid running out of memory or wasting time on unnecessary operations. I now went through the changes and cleaned them up a bit, because I'd like to merge some/most/all (?) of them for the next time we need to bulk-process the bridge descriptor archive. I'll post a branch once I have a ticket number.

We should discuss which of these commits should go in by default (maybe ed48f03, ae5c53c, and e514d30?), which should only be enabled in a special bulk-processing mode (maybe df96751, 27cbfc8, and 68b29c2?), which should have their own config option (ugh!), or which we drop because we don't need as badly for processing descriptors in bulk.

Clearly, these commits need work, but I figured it's better to clean them up a bit now than attempt to do that in four or eight weeks. Branch follows in a minute.

Assignee
Assign to
Time tracking