Add capability fallback in case user namespaces are not available

Some distros like Ubuntu do not have user namespaces. It would be nice if those could still be supported, maybe with our pre v0.4.0 approach?