The geometry of space at the center of the Earth does not obey the same relativistic physics as the large scale geometry of the universe. You are trying to apply Newtonian gravitational theory to a situation ( the universe ) where it does not apply because of the expansion and curvature of space.