fsn-node-04 disk not synchronized
While rebooting fsn-node-04 with --ganeti-migrate-back
I rebooted some instances, and I think one of the instances was rebooted while it was migrating. The reboot script printed
host fsn-node-04.torproject.org rebooted
migrating back 6 instances
Tue Aug 2 21:51:18 2022 Migrating instance chives.torproject.org
Tue Aug 2 21:51:19 2022 * checking disk consistency between source and target
Tue Aug 2 21:51:19 2022 - WARNING: Can't find disk on node fsn-node-04.torproject.org
Failure: command execution error:
Disk 0 is degraded or not fully synchronized on target node, aborting migration
unexpected exception during reboot: [<UnexpectedExit: cmd='gnt-instance migrate -f chives.torproject.org' exited=1>] Encountered a bad command exit code!
Command: 'gnt-instance migrate -f chives.torproject.org'
After checking gnt-instance chives.torproject.org | grep drbd
the output told me both disks were in sync. Running gnt-instance migrate chives.torproject.org
worked fine and migrated back without issue, so hopefully it just took a second for fsn-node-04 to resync.