Warn if votes disagree too much about any given flag
I noticed yesterday that many, many relays only receive the BadExit flag from a single authority which is not enough for that flag to be included in the consensus. I asked arma about this, who didn't know about it and who fixed it right away, so that there are now two authorities voting BadExit on those relays. He also asked if there's a way for DocTor to notify us about such things.
Here's the data I used. For example, "2015-10-26 12:00:00,BadExit,1,2,58"
means that on 2015-10-26 at 12:00:00, there were 58 relays that received the BadExit flag from exactly 1 directory authority where 2 would have been required for that flag to be included in the consensus. One day later, "2015-10-27 12:00:00,BadExit,1,2,7"
, only 7 relays remained that only received a single BadExit flag in the votes.
validafter,attribute,votes,required,relays
2015-10-26 12:00:00,Authority,1,5,0
2015-10-26 12:00:00,Authority,2,5,0
2015-10-26 12:00:00,Authority,3,5,0
2015-10-26 12:00:00,Authority,4,5,0
2015-10-26 12:00:00,Authority,5,5,0
2015-10-26 12:00:00,Authority,6,5,0
2015-10-26 12:00:00,Authority,7,5,0
2015-10-26 12:00:00,Authority,8,5,10
2015-10-26 12:00:00,BadExit,1,2,58
2015-10-26 12:00:00,BadExit,2,2,1
2015-10-26 12:00:00,BadExit,3,2,4
2015-10-26 12:00:00,Exit,1,5,6
2015-10-26 12:00:00,Exit,2,5,16
2015-10-26 12:00:00,Exit,3,5,13
2015-10-26 12:00:00,Exit,4,5,26
2015-10-26 12:00:00,Exit,5,5,19
2015-10-26 12:00:00,Exit,6,5,33
2015-10-26 12:00:00,Exit,7,5,178
2015-10-26 12:00:00,Exit,8,5,761
2015-10-26 12:00:00,Fast,1,5,305
2015-10-26 12:00:00,Fast,2,5,54
2015-10-26 12:00:00,Fast,3,5,823
2015-10-26 12:00:00,Fast,4,5,84
2015-10-26 12:00:00,Fast,5,5,110
2015-10-26 12:00:00,Fast,6,5,241
2015-10-26 12:00:00,Fast,7,5,459
2015-10-26 12:00:00,Fast,8,5,4072
2015-10-26 12:00:00,Guard,1,5,211
2015-10-26 12:00:00,Guard,2,5,98
2015-10-26 12:00:00,Guard,3,5,87
2015-10-26 12:00:00,Guard,4,5,94
2015-10-26 12:00:00,Guard,5,5,129
2015-10-26 12:00:00,Guard,6,5,175
2015-10-26 12:00:00,Guard,7,5,646
2015-10-26 12:00:00,Guard,8,5,865
2015-10-26 12:00:00,HSDir,1,5,117
2015-10-26 12:00:00,HSDir,2,5,59
2015-10-26 12:00:00,HSDir,3,5,33
2015-10-26 12:00:00,HSDir,4,5,25
2015-10-26 12:00:00,HSDir,5,5,38
2015-10-26 12:00:00,HSDir,6,5,349
2015-10-26 12:00:00,HSDir,7,5,1455
2015-10-26 12:00:00,HSDir,8,5,1136
2015-10-26 12:00:00,Measured,1,3,57
2015-10-26 12:00:00,Measured,2,3,102
2015-10-26 12:00:00,Measured,3,3,198
2015-10-26 12:00:00,Measured,4,3,491
2015-10-26 12:00:00,Measured,5,3,6361
2015-10-26 12:00:00,Running,1,5,13
2015-10-26 12:00:00,Running,2,5,37
2015-10-26 12:00:00,Running,3,5,11
2015-10-26 12:00:00,Running,4,5,77
2015-10-26 12:00:00,Running,5,5,13
2015-10-26 12:00:00,Running,6,5,59
2015-10-26 12:00:00,Running,7,5,85
2015-10-26 12:00:00,Running,8,5,6455
2015-10-26 12:00:00,Stable,1,5,383
2015-10-26 12:00:00,Stable,2,5,49
2015-10-26 12:00:00,Stable,3,5,36
2015-10-26 12:00:00,Stable,4,5,48
2015-10-26 12:00:00,Stable,5,5,58
2015-10-26 12:00:00,Stable,6,5,122
2015-10-26 12:00:00,Stable,7,5,2353
2015-10-26 12:00:00,Stable,8,5,2879
2015-10-26 12:00:00,V2Dir,1,5,1
2015-10-26 12:00:00,V2Dir,2,5,27
2015-10-26 12:00:00,V2Dir,3,5,0
2015-10-26 12:00:00,V2Dir,4,5,42
2015-10-26 12:00:00,V2Dir,5,5,0
2015-10-26 12:00:00,V2Dir,6,5,5
2015-10-26 12:00:00,V2Dir,7,5,25
2015-10-26 12:00:00,V2Dir,8,5,4567
2015-10-26 12:00:00,Valid,1,5,5
2015-10-26 12:00:00,Valid,2,5,31
2015-10-26 12:00:00,Valid,3,5,1
2015-10-26 12:00:00,Valid,4,5,71
2015-10-26 12:00:00,Valid,5,5,3
2015-10-26 12:00:00,Valid,6,5,5
2015-10-26 12:00:00,Valid,7,5,37
2015-10-26 12:00:00,Valid,8,5,7282
2015-10-27 12:00:00,Authority,1,5,0
2015-10-27 12:00:00,Authority,2,5,0
2015-10-27 12:00:00,Authority,3,5,0
2015-10-27 12:00:00,Authority,4,5,0
2015-10-27 12:00:00,Authority,5,5,0
2015-10-27 12:00:00,Authority,6,5,0
2015-10-27 12:00:00,Authority,7,5,1
2015-10-27 12:00:00,Authority,8,5,9
2015-10-27 12:00:00,BadExit,1,2,7
2015-10-27 12:00:00,BadExit,2,2,51
2015-10-27 12:00:00,BadExit,3,2,4
2015-10-27 12:00:00,Exit,1,5,6
2015-10-27 12:00:00,Exit,2,5,15
2015-10-27 12:00:00,Exit,3,5,18
2015-10-27 12:00:00,Exit,4,5,27
2015-10-27 12:00:00,Exit,5,5,21
2015-10-27 12:00:00,Exit,6,5,38
2015-10-27 12:00:00,Exit,7,5,173
2015-10-27 12:00:00,Exit,8,5,761
2015-10-27 12:00:00,Fast,1,5,285
2015-10-27 12:00:00,Fast,2,5,55
2015-10-27 12:00:00,Fast,3,5,852
2015-10-27 12:00:00,Fast,4,5,77
2015-10-27 12:00:00,Fast,5,5,111
2015-10-27 12:00:00,Fast,6,5,221
2015-10-27 12:00:00,Fast,7,5,489
2015-10-27 12:00:00,Fast,8,5,4060
2015-10-27 12:00:00,Guard,1,5,212
2015-10-27 12:00:00,Guard,2,5,105
2015-10-27 12:00:00,Guard,3,5,88
2015-10-27 12:00:00,Guard,4,5,92
2015-10-27 12:00:00,Guard,5,5,125
2015-10-27 12:00:00,Guard,6,5,175
2015-10-27 12:00:00,Guard,7,5,661
2015-10-27 12:00:00,Guard,8,5,850
2015-10-27 12:00:00,HSDir,1,5,100
2015-10-27 12:00:00,HSDir,2,5,85
2015-10-27 12:00:00,HSDir,3,5,18
2015-10-27 12:00:00,HSDir,4,5,29
2015-10-27 12:00:00,HSDir,5,5,26
2015-10-27 12:00:00,HSDir,6,5,188
2015-10-27 12:00:00,HSDir,7,5,829
2015-10-27 12:00:00,HSDir,8,5,1934
2015-10-27 12:00:00,Measured,1,3,81
2015-10-27 12:00:00,Measured,2,3,111
2015-10-27 12:00:00,Measured,3,3,189
2015-10-27 12:00:00,Measured,4,3,492
2015-10-27 12:00:00,Measured,5,3,6361
2015-10-27 12:00:00,Running,1,5,14
2015-10-27 12:00:00,Running,2,5,48
2015-10-27 12:00:00,Running,3,5,6
2015-10-27 12:00:00,Running,4,5,65
2015-10-27 12:00:00,Running,5,5,13
2015-10-27 12:00:00,Running,6,5,65
2015-10-27 12:00:00,Running,7,5,97
2015-10-27 12:00:00,Running,8,5,6473
2015-10-27 12:00:00,Stable,1,5,371
2015-10-27 12:00:00,Stable,2,5,41
2015-10-27 12:00:00,Stable,3,5,34
2015-10-27 12:00:00,Stable,4,5,45
2015-10-27 12:00:00,Stable,5,5,52
2015-10-27 12:00:00,Stable,6,5,129
2015-10-27 12:00:00,Stable,7,5,2332
2015-10-27 12:00:00,Stable,8,5,2897
2015-10-27 12:00:00,V2Dir,1,5,0
2015-10-27 12:00:00,V2Dir,2,5,26
2015-10-27 12:00:00,V2Dir,3,5,1
2015-10-27 12:00:00,V2Dir,4,5,47
2015-10-27 12:00:00,V2Dir,5,5,0
2015-10-27 12:00:00,V2Dir,6,5,11
2015-10-27 12:00:00,V2Dir,7,5,41
2015-10-27 12:00:00,V2Dir,8,5,4596
2015-10-27 12:00:00,Valid,1,5,1
2015-10-27 12:00:00,Valid,2,5,37
2015-10-27 12:00:00,Valid,3,5,2
2015-10-27 12:00:00,Valid,4,5,74
2015-10-27 12:00:00,Valid,5,5,4
2015-10-27 12:00:00,Valid,6,5,11
2015-10-27 12:00:00,Valid,7,5,50
2015-10-27 12:00:00,Valid,8,5,7306
I'm not sure what would be good thresholds for DocTor to send out warnings. Maybe: if more than x% of relays receiving a flag in any of the votes don't receive enough votes for that flag to be included in the consensus, with x = 20?