This effectively reverts 71e3d52f, which was itself a revert of disabling this test the first time.
Sadly it still doesn't seem to be reliable. We have agreed on IRC to disable it for now.
Workaround for #1607