Reduce the number of travis jobs
After #24629 (moved), we have some follow-up work.
In 0.2.9 and later:
- work out if we really need clang and gcc on Linux and macOS
In 0.3.2 and later:
- reduce the number of rust online travis jobs, to reduce travis network failures