We need robots.txt in all our website

See: https://trac.torproject.org/projects/tor/ticket/33496