Not at the level of a PhD. But that doesn't mean that other careers in space science are closed to you. It only means that if you want to do professional research, you need to enhance your math and physics skills. Sorry I cannot be more optimistic, but without good skills in math and physics, it would be like asking whether you can be a surgeon without having a solid grasp of human anatomy, or chemistry...