arti hss generates many hsdir 400 errors
Empirically (using my wip IPT persistence branch, although that shouldn't matter for this) I sometimes get a lot of 400 errors from hsdirs, if I restart my instance of Arti. Log below the cut.
It seems likely that this is a bug in something we are doing.
2023-11-29T18:59:21Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$09bfe6a362d2ce435c45f99b56171b6da486d0f1, hsdir_rsa_id=$09bfe6a362d2ce435c45f99b56171b6da486d0f1): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 3 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: circuit failed: Circuit took too long to build
Attempt 3: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:21Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=2 can_retry=true
2023-11-29T18:59:21Z DEBUG tor_hsservice::svc::publish::reactor: successfully uploaded descriptor to HSDir nickname=ztest hsdir_id=$5d263037fc175596b3a344132b0b755eb8fb1d1c hsdir_rsa_id=$5d263037fc175596b3a344132b0b755eb8fb1d1c
2023-11-29T18:59:21Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=3 can_retry=true
2023-11-29T18:59:21Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$c7643ef0bc0e452c293534d6429d1d7937776483, hsdir_rsa_id=$c7643ef0bc0e452c293534d6429d1d7937776483): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 2 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:22Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: circuit failed attempt=3 can_retry=true
2023-11-29T18:59:22Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$09bfe6a362d2ce435c45f99b56171b6da486d0f1, hsdir_rsa_id=$09bfe6a362d2ce435c45f99b56171b6da486d0f1): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 3 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: circuit failed: Circuit took too long to build
Attempt 3: circuit failed: Circuit took too long to build
2023-11-29T18:59:23Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=3 can_retry=true
2023-11-29T18:59:23Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$403d9e1ddd8e66fa8081deae17c94b2d1d1f6164, hsdir_rsa_id=$403d9e1ddd8e66fa8081deae17c94b2d1d1f6164): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 2 times, but all attempts failed
Attempt 1: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:24Z DEBUG tor_proto::circuit::reactor: Circ 0.62: Truncated from hop #1. Reason: Circuit was destroyed without client truncate [DESTROYED]
2023-11-29T18:59:25Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$b4f2c6b03ca4c0c551915d4ffc6ca67ee1b34130, hsdir_rsa_id=$b4f2c6b03ca4c0c551915d4ffc6ca67ee1b34130): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 3 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 3: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:25Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=3 can_retry=true
2023-11-29T18:59:25Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$21fff594cfe691a4a03b828e9597a9f74f878053, hsdir_rsa_id=$21fff594cfe691a4a03b828e9597a9f74f878053): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 2 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:25Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$a15676f5f0f2ba7b1ca54446ddb46bee6f699a95, hsdir_rsa_id=$a15676f5f0f2ba7b1ca54446ddb46bee6f699a95): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 3 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 3: circuit failed: Circuit took too long to build
2023-11-29T18:59:25Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=3 can_retry=true
2023-11-29T18:59:26Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$5d263037fc175596b3a344132b0b755eb8fb1d1c, hsdir_rsa_id=$5d263037fc175596b3a344132b0b755eb8fb1d1c): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 2 times, but all attempts failed
Attempt 1: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:27Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=2 can_retry=true
2023-11-29T18:59:28Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=4 can_retry=true
2023-11-29T18:59:28Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$1e073339919f3ad1e82755a909cf458ccc6252d1, hsdir_rsa_id=$1e073339919f3ad1e82755a909cf458ccc6252d1): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 3 times, but all attempts failed
Attempt 1: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 3: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:30Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=4 can_retry=true
2023-11-29T18:59:31Z DEBUG tor_hsservice::svc::publish::backoff: failed to upload a hidden service descriptor: descriptor upload request failed attempt=3 can_retry=true
2023-11-29T18:59:33Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$b4f2c6b03ca4c0c551915d4ffc6ca67ee1b34130, hsdir_rsa_id=$b4f2c6b03ca4c0c551915d4ffc6ca67ee1b34130): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 4 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 3: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 4: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:34Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$fe39f07ebe7870dce124ab30df3abd0700a43f75, hsdir_rsa_id=$fe39f07ebe7870dce124ab30df3abd0700a43f75): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 4 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: circuit failed: Circuit took too long to build
Attempt 3: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 4: descriptor upload request failed: Request failed: HTTP status code 400
2023-11-29T18:59:36Z WARN tor_hsservice::svc::publish::reactor: failed to upload descriptor for service ztest (hsdir_id=$21fff594cfe691a4a03b828e9597a9f74f878053, hsdir_rsa_id=$21fff594cfe691a4a03b828e9597a9f74f878053): error: failed to publish a descriptor: Tried to upload a hidden service descriptor 3 times, but all attempts failed
Attempt 1: circuit failed: Circuit took too long to build
Attempt 2: descriptor upload request failed: Request failed: HTTP status code 400
Attempt 3: descriptor upload request failed: Request failed: HTTP status code 400