Stop forcing prefer IPv6 on non-SOCKSPorts

In #32637 (moved) we forced PreferIPv6 on all non-SOCKSPorts.

That could be a breaking change for some users, and they will have no way to recover. We should just set a sensible default, and let users tweak it if it doesn't work for them.