Tor Check's TorBulkExitList.py script returns duplicated addresses
For example, part of the results from https://check.torproject.org/cgi-bin/TorBulkExitList.py?ip=38.229.72.19&port=443 just now:
37.130.227.133
37.130.227.133
37.131.185.47
37.139.3.171
37.143.9.74
37.147.45.175
37.157.192.208
37.157.194.210
37.157.195.178
37.157.195.83
37.187.107.210
37.187.114.36
37.187.129.166
37.187.129.166
37.187.2.229
37.187.21.180
37.187.239.191
37.187.244.40
37.187.246.221
37.187.38.147
37.187.39.210
37.187.51.210
which has multiple duplicates.
I assume the script has a list.sort()
somewhere in there. All that is needed to get rid of the duplicates is set(list.sort()
.