Don't fetch from very skewed directories

If our observed skew from a directory source is too large, then we can be certain it won't give us a consensus we want, since anything it believes in will be expired according to us.

Part of #329 (closed). Split off from #436.