Ingestion of new documents is busted
We have seen twice now that the ingestion of any new document (at least relay descriptor related) gets stopped for unknown reasons. At the time of filing this ticket (around 1200UTC 12/21/2023) the latest consensus in /srv/parser.torproject.org/parser/descriptors/relay-descriptors/consensuses
is from 2023-12-20-15-00-00. Similarly, the latest bandwidth file in the bandwidth
dir is from 2023-12-20-14-39-20.
I've seen twice thousands of errors like the following that might be related:
2023-12-20 15:50:55,931 INFO o.t.m.d.u.PsqlConnector:46 Connected to the PostgreSQL server successfully.
2023-12-20 15:50:56,684 WARN o.t.m.d.p.BandwidthParser:439 ERROR: duplicate key value violates unique constraint "bandwidth_record_pkey"
Detail: Key (digest, "time")=(gljFd57/3Qns/uesG7Zgwt1BhzROYK2YjG7Zl4tRHVw, 2023-11-21 01:06:42) already exists.
2023-12-20 15:50:56,687 WARN o.t.m.d.p.BandwidthParser:439 ERROR: duplicate key value violates unique constraint "bandwidth_record_pkey"
Detail: Key (digest, "time")=(rvuNn33OeoRBczYP6xTfbxZyzsM50xL1u80o0T3Z+/o, 2023-11-20 18:33:47) already exists.
2023-12-20 15:50:56,689 WARN o.t.m.d.p.BandwidthParser:439 ERROR: duplicate key value violates unique constraint "bandwidth_record_pkey"
However, I was unable to find other logs that might indicate better what the actual problem is.
Edited by Georg Koppen