gettor not answering emails Mar 3
A user on #tor reports that mailing gettor results in no reply.
I sent a mail of my own, and also got no reply.
I checked with eugeni, and mail is arriving there and being passed to gettor-01 ok.
I checked with gettor-01's postfix logs, and mail is being delivered to /srv/gettor.torproject.org/home/gettor/scripts/process_email ok.
The end of /srv/gettor.torproject.org/home/gettor/log/gettor.log says
2021-03-03T14:07:10+0000 [-] Received SIGTERM, shutting down.
2021-03-03T14:07:10+0000 [gettor#info] SERVICE:: Stopping twitterdm service.
2021-03-03T14:07:10+0000 [gettor#info] SERVICE:: Service stopped.
2021-03-03T14:07:10+0000 [gettor#info] SERVICE:: Stopping sendmail service.
2021-03-03T14:07:10+0000 [gettor#info] SERVICE:: Service stopped.
2021-03-03T14:07:10+0000 [-] Main loop terminated.
2021-03-03T14:07:10+0000 [twisted.scripts._twistd_unix.UnixAppLogger#info] Server Shut Down.
So it looks like something shut down some part of gettor today at 14utc? And maybe that's why it doesn't respond?
I found our gettor survival guide (yay) at
https://gitlab.torproject.org/tpo/anti-censorship/gettor-project/gettor/-/wikis/Gettor-Service-Operator-HowTo
And I logged in, did a sudo -u gettor -s, and ran "/home/gettor/gettor/bin/gettor_service start", and got this traceback mess:
gettor@gettor-01:/srv/gettor.torproject.org/home/gettor/log$ /home/gettor/gettor/bin/gettor_service start
Unhandled Error
Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/twisted/application/app.py", line 674, in run
runApp(config)
File "/usr/lib/python3/dist-packages/twisted/scripts/twistd.py", line 25, in runApp
runner.run()
File "/usr/lib/python3/dist-packages/twisted/application/app.py", line 381, in run
self.application = self.createOrGetApplication()
File "/usr/lib/python3/dist-packages/twisted/application/app.py", line 453, in createOrGetApplication
application = getApplication(self.config, passphrase)
--- <exception caught here> ---
File "/usr/lib/python3/dist-packages/twisted/application/app.py", line 464, in getApplication
application = service.loadApplication(filename, style, passphrase)
File "/usr/lib/python3/dist-packages/twisted/application/service.py", line 416, in loadApplication
application = sob.loadValueFromFile(filename, 'application')
File "/usr/lib/python3/dist-packages/twisted/persisted/sob.py", line 173, in loadValueFromFile
with open(filename, 'r') as fileObj:
builtins.FileNotFoundError: [Errno 2] No such file or directory: 'scripts/gettor'
Failed to load application: [Errno 2] No such file or directory: 'scripts/gettor'
I got something similar in the 'restart' case except it starts with
cat: gettor.pid: No such file or directory
kill: usage: kill [-s sigspec | -n signum | -sigspec] pid | jobspec ... or kill -l [sigspec]
before giving me the traceback.
Ok, it looks like that script quietly demands to be started from the right directory. I moved to that directory and ran the start command and got no response and now there is a new twistd3 process running, woo, and I got my gettor email response.