THink of a ball. There's one point on the ball that's the top of the ball. It's a very precise point, but it's there. Any direction you go from that point isn't going around the ball - it's just down.

Once you're off that point, you can go around the ball. But on that one point, all you can go is down.

Earth is the same.