Make config builders, not validated structs, [de]serialize

This completes #371 (closed) and is the last work item from #285 (closed) that isn't localised (to a particular crate or layer, or to a particular area of configuration).