Browser chrome breaks when private browsing mode is turned off

As reported in #40683 (comment 2759516), deselecting Always use private browsing mode in about:preferences#privacy breaks the browser chrome after restarting Tor Browser. This issue is reliably reproduce-able in Windows, Linux & MacOS.