Run all of our python tests everytime. This is a quick workaround for tests to pass, before I address it properly in #44149