Modeling The Physical World For Data-Centric Robotics