The gravitational field is more than just a region of influence within time and space. The gravitational field is spacetime. There was no one on the swings.