Consensus-health checker should warn if auths assign flags to unusually few or many relays

We should notice cases like legacy/trac#8683 (moved) much earlier by adding an alert to the consensus-health checker. It could simply compare the number of flags in a vote and in the consensus. If there are more than, say, 250 relays that have a certain flag only in a vote or only in the consensus, the consensus-health checker should emit a warning. See also the bottom of the consensus-health output page for recent numbers. Related to legacy/trac#8164 (moved).

added component::archived/doctor in Legacy / Trac owner::atagar in Legacy / Trac priority::medium in Legacy / Trac resolution::worksforme in Legacy / Trac status::closed in Legacy / Trac type::enhancement in Legacy / Trac labels

Trac:

The attached graph shows the number of flags that are either only in a vote or only in the consensus (and not in the authorities' vote). The dashed line is the threshold when we could start warning.

atagar, is this something you want to do in your Python DocTor? If not, I'd close this ticket, because I'm not working on the Java DocTor anymore. Thanks!

Trac:
Cc: N/A to atagar

Is this something actionable? Like legacy/trac#8164 (moved) this seems like an oddity rather than a problem. If we have well defined constraints and a specific action authority operators should take in response then sure.

Trac:
Owner: N/A to atagar
Component: Metrics Utilities to DocTor

Agreed, this requires more analysis first. Feel free to close, or change priority to minor or trivial, I'd say.

Gonna resolve for now. Feel free to reopen if anyone would like to discuss this more.

Trac:
Status: new to closed
Resolution: N/A to worksforme

closed

mentioned in issue legacy/trac#10018 (moved)

moved from legacy/trac#8797 (moved)

added Feature label and removed 1 deleted label

removed 1 deleted label