Make sure fallback whitelist entries are unique

We shouldn't be duplicating fingerprint, or any address/port combination.

But there's no urgency here, it's mostly harmless, it just means we won't catch relays that switch details.