shadow and tornettools dieing silently on ci-runner-x86-05-shadow / shadow-small
Example: https://gitlab.torproject.org/jnewsome/sponsor-61-sims/-/jobs/63872
In the console log of the job, the tornettools simulate
was the last command from the main script to execute, and presumably exited with a non-zero exit code. The next commands are the after_script
(which has another failure copying a file, as a result of the early exit from the main script).
The tornettools simulate log and the shadow log both end abruptly, without the normal "finished" log messages, but also without logging any fatal errors.
Using the web terminal of another job, it doesn't look like there are any core files:
# cat /proc/sys/kernel/core_pattern
core
root@runner-rkjlxrhv-project-969-concurrent-0:/# find /shadow/*/*/63872 -name core
root@runner-rkjlxrhv-project-969-concurrent-0:/#
In the past I've seen similar mysterious errors due to hitting resource limits, but afaict everything looks good: tpo/tpa/team#40500 (comment 2764039)