Plan a response to the upcoming settings redesign

Bugzilla: Bug 1951140